-- Logs begin at Wed 2022-08-03 12:13:05 UTC, end at Wed 2022-08-03 13:26:59 UTC. -- Aug 03 12:50:03.029736 dv-cinder-851996-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 03 12:50:03.038357 dv-cinder-851996-1-smb devstack@keystone.service[80439]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:50:03 2022] *** Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: nodename: dv-cinder-851996-1-smb Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: machine: x86_64 Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: clock source: unix Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: pcre jit disabled Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: detected number of CPU cores: 4 Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: current working directory: / Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:50:03.040360 dv-cinder-851996-1-smb devstack@keystone.service[80439]: your processes number limit is 47680 Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: your memory page size is 4096 bytes Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: detected max file descriptor number: 2048 Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: lock engine: pthread robust mutexes Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: thunder lock: enabled Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 03 12:50:03.040964 dv-cinder-851996-1-smb devstack@keystone.service[80439]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:50:03.081031 dv-cinder-851996-1-smb devstack@keystone.service[80439]: Python main interpreter initialized at 0x56464772d9c0 Aug 03 12:50:03.081031 dv-cinder-851996-1-smb devstack@keystone.service[80439]: python threads support enabled Aug 03 12:50:03.081031 dv-cinder-851996-1-smb devstack@keystone.service[80439]: your server socket listen backlog is limited to 100 connections Aug 03 12:50:03.081031 dv-cinder-851996-1-smb devstack@keystone.service[80439]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:50:03.081391 dv-cinder-851996-1-smb devstack@keystone.service[80439]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:50:03.081468 dv-cinder-851996-1-smb devstack@keystone.service[80439]: *** Operational MODE: preforking *** Aug 03 12:50:03.081758 dv-cinder-851996-1-smb devstack@keystone.service[80439]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:50:03.081758 dv-cinder-851996-1-smb devstack@keystone.service[80439]: spawned uWSGI master process (pid: 80439) Aug 03 12:50:03.082010 dv-cinder-851996-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 03 12:50:03.086736 dv-cinder-851996-1-smb devstack@keystone.service[80439]: spawned uWSGI worker 1 (pid: 80453, cores: 1) Aug 03 12:50:03.086736 dv-cinder-851996-1-smb devstack@keystone.service[80439]: spawned uWSGI worker 2 (pid: 80454, cores: 1) Aug 03 12:50:03.086736 dv-cinder-851996-1-smb devstack@keystone.service[80439]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:50:08.631974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:08.631974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: from cryptography.utils import int_from_bytes Aug 03 12:50:08.632772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:08.632772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: from cryptography.utils import int_from_bytes Aug 03 12:50:08.632887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:08.632887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: from cryptography.utils import int_from_bytes Aug 03 12:50:08.632887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:50:08.632887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: from cryptography.utils import int_from_bytes Aug 03 12:50:08.683118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:50:08.683315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:50:08.683484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] command line args: [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:50:08.683754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:50:08.683930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ================================================================================ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:50:08.684183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:50:08.684267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] admin_token = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.684385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:50:08.684469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_dir = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.684573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] command line args: [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:50:08.684659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.684766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_source = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.684838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:50:08.684940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] debug = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ================================================================================ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:50:08.685142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] admin_token = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] config_dir = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] config_source = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685918 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.685998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] debug = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_config_append = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.686934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_dir = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_config_append = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.687839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_dir = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.688983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.689166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.689336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.689487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.689657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.689828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.690008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.690197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.690197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.690539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.690739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.691864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] publish_errors = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.692931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] publish_errors = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] standard_threads = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.693937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_journal = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] standard_threads = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_json = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_stderr = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_syslog = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.694961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] use_journal = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.695410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] use_json = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.695616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] use_stderr = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.695891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] use_syslog = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.695891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:50:08.696076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.696965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.697908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.698993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.699920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.700034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.700147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.700259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.700259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.700484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.701945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.702932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.703905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.704950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.705927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.706994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.707848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.708976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.709927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.710901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.711945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.712914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.713853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.714972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.715992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.716921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.717998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.718974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.external = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.external = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.719940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.password = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.token = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.password = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.720968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] auth.token = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.721904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.722060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.722139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.722889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.722970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.723956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.724919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.725921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.726949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.727898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.728864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.729994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.730964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.731917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.732979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.733902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.734893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.735985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.736930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.737737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.738483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.738588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.738683 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.738809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.738944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.739949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.740893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.741987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.742952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.743988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.744914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.745860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.746889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.747986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.748994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.749933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.750910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.751939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.752913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.753823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] role.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] role.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.754999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.755997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.756979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.757963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.758929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.759928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.760862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.761973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.762930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.763968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.764935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.765880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.766852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.767878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.768964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.769856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.770990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:50:08.771454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.771922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:50:08.772093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:50:08.801917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.802137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.802362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.802446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.802614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.802869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.810665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.811174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.839981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.840215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.840392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.840625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.892846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.892976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.944091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.944326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.944441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:08.944676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.009974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.010066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.010191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.010274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.010405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.010488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.033920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.034774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.035547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.035686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.035825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.035965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.036070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.036137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.036211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.047159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.047464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.060987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.061117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.061199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.061329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.061413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.061542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:50:09.078109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.078318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:50:09.078650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.078881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:50:09.079064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.079222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.079351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:50:09.079431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.079595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.079679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.079794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:50:09.079876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.080060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.080317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.080572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.080825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.090185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.090461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.090744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.091030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.091249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.091531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.091801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.092082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.098765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.099685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.103470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.103752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.104596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.104937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.105928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.106009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.106191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.106272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.106478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.106774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.107045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.129315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.130430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.130841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.131108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.131955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.132236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.135726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.136003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.136282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.136884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.137199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.137440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.148016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.148016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.148386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.148386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.148515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.148515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.148638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.148863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.149142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.149923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.150003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.150192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.150470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.150757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.151035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.166542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.166842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.167717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.168245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.171031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.172195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.174166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.174458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.177239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.177239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.178898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.180080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.182077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.183318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.185326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.185626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.185914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.186207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.186483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.186567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.186792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.186876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.187093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.187381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.187658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.187949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.202749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.203035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.203303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.203563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.204090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.204375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.204642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.204907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.211059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.212362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.212595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.212868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.213897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.214172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.215790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.216070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.216360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.216640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.216924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.217031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.217310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.217600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.217883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.218178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.229080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.229356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.229628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.229901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.230176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.230318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.230454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.230600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.230760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.230906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.231185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.231467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.231743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.232029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.246408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.247719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.249462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.250678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.252425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.254311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.255440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.256941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.257026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.257244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.257527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.258524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.258853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.259137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.264001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.265602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.265699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.267236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.268606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.268896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.269733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.270005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.270999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.271290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.271574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.271849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.278072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.278358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.278649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.279921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.280206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.280498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.285543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.285819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.286099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.286375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.286654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.286959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.287231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.287444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:50:09.287529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.287725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.287860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.288980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.289131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.289237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.289401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.289772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.290053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.290349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.290626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.290938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.291202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:50:09.323515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56464772d9c0 pid: 80453 (default app) Aug 03 12:50:09.325527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56464772d9c0 pid: 80454 (default app) Aug 03 12:50:09.327004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301a31-a8e2-4766-94cd-f10cc2ff1d19 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:09.327298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301a31-a8e2-4766-94cd-f10cc2ff1d19 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:09.327575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301a31-a8e2-4766-94cd-f10cc2ff1d19 None None] PATH_INFO: `/v3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:09.332349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed Aug 3 12:50:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:17.809730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:17.810275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:17.810275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:17.814578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:17.820327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:17.820747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:17.820892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:17.891652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: INFO dbcounter [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] Registered counter for database keystone Aug 03 12:50:17.910884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG oslo_db.sqlalchemy.engines [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:17.917044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writer thread running {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:18.097296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG passlib.handlers.bcrypt [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80453) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:50:18.101741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG passlib.handlers.bcrypt [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80453) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:50:18.152749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:18.154411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:18.286831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:50:18.420605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:18.490603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: INFO dbcounter [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] Registered counter for database keystone Aug 03 12:50:18.511434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG oslo_db.sqlalchemy.engines [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:50:18.517521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writer thread running {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:50:18.635869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae1f0-e9c7-41c2-9fdf-a05c07c53289 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:18.640163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:18.640787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:18.641067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:18.641342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:18.649878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:18.702378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:50:18.702730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c63fe-6801-4c13-89a3-7f8e515106fc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:18.713336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Aug 3 12:50:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:50:18.719232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:18.734207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3338-44f4-490e-a712-a17cf9e25a59 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:18.738870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:18.739986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:18.740263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:18.740536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] PATH_INFO: `/v3/projects/5cd5462246264f9f811047550f1e206f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:18.742007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] RBAC: Authorizing `identity:get_project(project_id=5cd5462246264f9f811047550f1e206f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:18.792519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING keystone.common.rbac_enforcer.enforcer [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:50:18.793107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c55ecb-dcaa-4188-9879-08ae452b35cb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:18.797688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed Aug 3 12:50:18 2022] GET /identity/v3/projects/5cd5462246264f9f811047550f1e206f => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:20.735221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc94f5-1117-43e0-9631-0e229983e509 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:20.735715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc94f5-1117-43e0-9631-0e229983e509 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:20.735824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc94f5-1117-43e0-9631-0e229983e509 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:20.739910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:20.745324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:20.745739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:20.745865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:20.766084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:20.767619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:20.776197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:50:20.797714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc94f5-1117-43e0-9631-0e229983e509 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:20.809605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc94f5-1117-43e0-9631-0e229983e509 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:20.813828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:20.814427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:20.814740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:20.815008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:20.823484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:20.825261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed59ae0-d5d9-42a2-a832-3b09fc52a80b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:20.834409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Aug 3 12:50:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:50:20.839484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:20.848284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f482c1-7832-4fa3-8779-a356d9dcf9ba None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:20.852647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:20.853264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:20.853540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:20.853810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:20.855177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:20.856978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127aff-7943-4d06-b81f-bee840ce67dd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:20.858494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed Aug 3 12:50:20 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:22.927998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d3a65-c8e5-4ea2-9465-e4a68da3f6c3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:22.928531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d3a65-c8e5-4ea2-9465-e4a68da3f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:22.928531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d3a65-c8e5-4ea2-9465-e4a68da3f6c3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:22.929901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:22.935219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:22.935610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:22.935766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:22.951435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2258b1-57eb-4598-8d07-3d62722e8941 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:22.951651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2258b1-57eb-4598-8d07-3d62722e8941 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:22.951933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2258b1-57eb-4598-8d07-3d62722e8941 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:22.953424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:22.955615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:22.957443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:22.958613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:22.958932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:22.959216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.000603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG passlib.handlers.bcrypt [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80454) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:50:23.001027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG passlib.handlers.bcrypt [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80454) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:50:23.035953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:23.047670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:23.049276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:23.058588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.083934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.151066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:23.164254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591f50-da91-444a-ac80-eae659529d5d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.172533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.198818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.199461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.199737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.200012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.211871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:23.220243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:23.221228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:23.222088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:23.227167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.274781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0a0e-6c94-4f4f-b410-9efe2dfbb0ac None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.276980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.311662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.311828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.312852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.313109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.313385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.330100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd7a32-1475-49c2-9788-eb5711ace5ed None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.366580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.367227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.367505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.367776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.368488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:23.368787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.370183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.382787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:23.384279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.385798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.388269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.482732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:50:23.487256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0aec8-7926-499b-ae4e-858ef71efd87 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.488862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.491979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.522810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.523448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.523733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.524007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.525178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.526633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.528255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:23.533599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.548314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.589163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4752a85-fc8b-498f-a351-72ae4ae94d44 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.627328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.628238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.628700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.629057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.649358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.650902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:50:23.671252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:23.672197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:23.673027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:50:23.673027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:50:23.673027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:50:23.673027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:23.673027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:23.679157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.733765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.743194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a58b8-f973-43e5-b7b3-c9fd0e7a751a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.775899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.776540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.776719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc546078-b9f1-4799-b16a-f2219a09e6b3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.776830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.777083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.778238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.779727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.781319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:23.787667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:23.812865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.813493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.813755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.814028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.814747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:23.815054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.816627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0cdbb-0da1-447c-9433-c88916e0c703 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.834041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:23.875947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:23.896753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dadb1-9685-486e-b5c6-d1f1a6c9147a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:23.933178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:23.933840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:23.934123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:23.934398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:23.935228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.domain.id=default, user.id=d5aedfbd59554662a405705e61102c08) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:23.935770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:23.936994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863771f1-1bae-4ca8-b75d-67ef8478394c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:23.944535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Aug 3 12:50:23 2022] GET /identity/v3/role_assignments?user.id=d5aedfbd59554662a405705e61102c08&scope.domain.id=default&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:26.182183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936543-ee18-4625-831c-313458f49ae3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.182764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936543-ee18-4625-831c-313458f49ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.182764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936543-ee18-4625-831c-313458f49ae3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.184091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:26.189411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b0b-a714-4d59-950d-8c61257c2b35 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.189846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b0b-a714-4d59-950d-8c61257c2b35 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.189949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b0b-a714-4d59-950d-8c61257c2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.213868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fc092b0b-a714-4d59-950d-8c61257c2b35 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:26.215112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fc092b0b-a714-4d59-950d-8c61257c2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:26.303581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:26.338455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936543-ee18-4625-831c-313458f49ae3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:26.357163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5b780-56b6-4da5-ad8e-2e26869cca07 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.357446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5b780-56b6-4da5-ad8e-2e26869cca07 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.357723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5b780-56b6-4da5-ad8e-2e26869cca07 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.359271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:26.365933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91189-7584-4f47-a48a-b3ae83f58e72 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.366223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91189-7584-4f47-a48a-b3ae83f58e72 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.366481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91189-7584-4f47-a48a-b3ae83f58e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.397741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-48c91189-7584-4f47-a48a-b3ae83f58e72 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:26.398958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-48c91189-7584-4f47-a48a-b3ae83f58e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:26.550704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936543-ee18-4625-831c-313458f49ae3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:26.565025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:26.586346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:26.591418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d267-97bd-4e32-87bf-d2f01c76257b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.591972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d267-97bd-4e32-87bf-d2f01c76257b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.592431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2d267-97bd-4e32-87bf-d2f01c76257b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.594062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 15/26] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:26.600201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b800a0-7efa-42a8-832c-2447721ce13f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.600804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b800a0-7efa-42a8-832c-2447721ce13f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.601298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b800a0-7efa-42a8-832c-2447721ce13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.605193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:26.605862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.606142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.606416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.616110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:26.620663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:26.628025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-82b800a0-7efa-42a8-832c-2447721ce13f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:26.628170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:26.629194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:26.629974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 12/27] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:26.630608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:26.637049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-82b800a0-7efa-42a8-832c-2447721ce13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:26.721914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 16/28] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 12:50:26.723552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27830-0a72-40c2-ba8a-7946061fb7e2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.724082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27830-0a72-40c2-ba8a-7946061fb7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.724614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27830-0a72-40c2-ba8a-7946061fb7e2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.730294 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 17/29] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:26.731301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27830-0a72-40c2-ba8a-7946061fb7e2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:26.754800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299543-e1c2-4c93-b20c-13f32f72ffcb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:26.809148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:26.809148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.809148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.809148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.821917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:26.823860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5a273cc4-0bf4-4d89-aca4-de025d94f3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:50:26.844395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:26.847877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 13/30] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.848691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.850671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27830-0a72-40c2-ba8a-7946061fb7e2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:26.895537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:26.896351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:26.896749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:26.897121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:26.898037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:26.898513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:26.900098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:26.901951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:26.911144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 18/31] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:26.912991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:26.982488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:26.984044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:27.008573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:27.047231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c76b9-17c5-48bb-b78a-ea836d92d8f9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.056442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 14/32] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:27.057530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.100191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.100864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.101143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.101415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.102162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.103637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.172570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1ede3-1c32-4b82-9bbd-141669671bdb None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.207945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.208548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.208824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.209092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.209773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:27.210073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.212087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.239638 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 15/33] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:27.241560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.277341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:27.353535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 19/34] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Aug 3 12:50:26 2022] POST /identity/v3/roles => generated 225 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:27.355775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.402446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eec2a4-a904-4a3a-9106-07090e6bf43d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.441535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:27.443322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.443987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.444265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.444539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.446173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.447775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.449548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 16/35] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:27 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:27.450216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.504520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669faa8-73d1-4458-bbe3-dda22f121915 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.544992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.545645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.545925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.546197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.546966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.548635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.568261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:27.586127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e00f2-466e-4581-b01b-0455134fb795 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.627758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.628979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.629269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.629906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.630594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.631606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 20/36] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Aug 3 12:50:27 2022] POST /identity/v3/roles => generated 219 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:27.632549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.633408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9d3a8-d1d8-4668-8e21-8ec102aca045 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.773485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b5d3-9906-41a8-8a4d-74f7ad38f121 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:27.794605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:27.819019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:27.819674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.819960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.820242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.822239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:27.823843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e29fda-9286-4c13-afbb-c8c48d3c3462 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:27.825686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 21/37] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:27.826705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8aecf-ee8f-42f1-936d-6aabafc887fd None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.827036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8aecf-ee8f-42f1-936d-6aabafc887fd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.827356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8aecf-ee8f-42f1-936d-6aabafc887fd None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.828765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 22/38] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:27.832455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8aecf-ee8f-42f1-936d-6aabafc887fd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:27.905465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 17/39] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:50:27 2022] POST /identity/v3/projects => generated 301 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:27.907443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cad8b9-8f86-4434-a808-1ad5919894be None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:27.907952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cad8b9-8f86-4434-a808-1ad5919894be None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:27.908441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cad8b9-8f86-4434-a808-1ad5919894be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:27.929265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-56cad8b9-8f86-4434-a808-1ad5919894be None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:27.931236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-56cad8b9-8f86-4434-a808-1ad5919894be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:27.953933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8aecf-ee8f-42f1-936d-6aabafc887fd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:28.000977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:28.001677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.001966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.002255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] PATH_INFO: `/v3/domains/default/users/d5aedfbd59554662a405705e61102c08/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.004911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d5aedfbd59554662a405705e61102c08, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:28.006436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:28.009712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 18/40] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:28.011335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89f74-bda5-4d53-afef-d0c4580a9197 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.011622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89f74-bda5-4d53-afef-d0c4580a9197 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.011901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a89f74-bda5-4d53-afef-d0c4580a9197 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.014749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 19/41] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:28.018691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.019734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.020167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.039275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:28.040505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:28.108722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:28.113891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 20/42] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:28.114702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:28.121898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 23/43] 10.222.0.67 () {58 vars in 1361 bytes} [Wed Aug 3 12:50:27 2022] PUT /identity/v3/domains/default/users/d5aedfbd59554662a405705e61102c08/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:28.139081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:28.194015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:28.236286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4e7ea-743e-4ffa-9e6a-827e50b4506b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:28.254229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530a140-b950-44a3-8009-4e0338dde6ff None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:28.285052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:28.285694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.285976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.286458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.287105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:28.288745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6dcd-68f7-4c87-942e-a5ec58c7e14e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:28.296121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:28.296780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.297091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.297429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.298597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:28.300150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:28.301911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 24/44] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:28.307481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:28.389306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 21/45] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Aug 3 12:50:28 2022] POST /identity/v3/roles => generated 223 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:28.413047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfaf4-d9a2-4685-bb65-4f73e2c19c5a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:28.429304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:28.454311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:28.454905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:28.455193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:28.455476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:28.456186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:28.458238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee344edc-5e1f-4385-bc9b-e74aa187f8c1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:28.546179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 25/46] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:50:28 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:50:30.112632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd764-912c-4c02-b81e-27d847e0b149 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.113145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd764-912c-4c02-b81e-27d847e0b149 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.113429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd764-912c-4c02-b81e-27d847e0b149 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.114821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 22/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:30.120212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.121005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.121489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.140397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:30.148336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:30.212138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 26/48] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:30.235375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd764-912c-4c02-b81e-27d847e0b149 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.296184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:30.339894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd764-912c-4c02-b81e-27d847e0b149 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:30.373043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:30.373616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.373907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.374188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.384661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:30.389996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:30.390849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:30.391623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 23/49] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:30.397584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.489827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:30.496355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c416-3f2c-4d6f-83f7-e6b4589cb8db None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:30.530798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:30.531537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.531828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.532105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.532824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:30.533129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:30.534569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca795ae-fe91-4cf6-82cd-d765437e3ecf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:30.543474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 27/50] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:30.548903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.572214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c34f-9956-4e04-ba61-0eac943130ee None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.572500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c34f-9956-4e04-ba61-0eac943130ee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.573197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3c34f-9956-4e04-ba61-0eac943130ee None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.574621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 28/51] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:30.580780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.581065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.581979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.602923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:30.604309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:30.661330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab380e-231c-4b1f-b47d-69585dc6afa0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:30.680668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 29/52] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:30.681075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:30.703033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:30.703960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.704083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.704264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.704964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.705444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:30.707398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:30.709625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 24/53] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:30.715509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.794434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:30.813826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8a04a-13ec-4b2a-a462-59011473a213 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:30.838070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b33d6-a488-4b7b-ac8b-fbc3636f4564 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:30.858814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:30.859461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.859739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.860011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.861326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:30.863468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:30.865282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 30/54] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:30.872498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.874002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:30.874663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:30.874977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:30.875259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:30.876439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:30.877892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:30.880328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 25/55] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:30.886259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:30.947103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:30.994559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ac9c7-c9f1-4249-b04e-7af74ca24d61 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:31.000905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c866a92-0867-4d00-a41d-2c273e3fc30a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:31.031153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:31.031782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:31.032066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:31.032346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:31.033134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.domain.id=default, user.id=d5aedfbd59554662a405705e61102c08) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:31.033442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:31.035101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92933-9ef8-460e-a621-23336b8d84f7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:31.038647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:31.039362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:31.039647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:31.039923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:31.040613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:31.042051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f62b-ef72-413c-affd-78fb034fc7b3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:31.044291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 26/56] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Aug 3 12:50:30 2022] GET /identity/v3/role_assignments?user.id=d5aedfbd59554662a405705e61102c08&scope.domain.id=default&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:31.153693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 31/57] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Aug 3 12:50:30 2022] POST /identity/v3/projects => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:50:33.188089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5612d-1066-444f-950f-8a82c75c6e48 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:33.188672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5612d-1066-444f-950f-8a82c75c6e48 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:33.188765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5612d-1066-444f-950f-8a82c75c6e48 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:33.190102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 27/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:33.195679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d28a9-d218-438f-9660-120106e7f09f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:33.196054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d28a9-d218-438f-9660-120106e7f09f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:33.196239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d28a9-d218-438f-9660-120106e7f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:33.208987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:33.214205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-547d28a9-d218-438f-9660-120106e7f09f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:33.215422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-547d28a9-d218-438f-9660-120106e7f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:33.280831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 32/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:33.305636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5612d-1066-444f-950f-8a82c75c6e48 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:33.402894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5612d-1066-444f-950f-8a82c75c6e48 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:33.419827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:33.436482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:33.437112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:33.437394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:33.437676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:33.438899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:33.440303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e47b7-be64-47a3-a7f6-5632ac36c4ee None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:33.442281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 28/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:33.447872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d28a9-d218-438f-9660-120106e7f09f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:33.546521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d28a9-d218-438f-9660-120106e7f09f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:33.579572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:33.580177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:33.580456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:33.580725 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:33.581712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:33.583319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111cac-44c1-479c-a1e7-4d6ea3f13e42 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:33.594727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:33.703921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 33/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:33 2022] POST /identity/v3/users => generated 275 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:36.788499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d86e0-d1d9-4192-aac6-14fdf80260b8 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:36.789472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d86e0-d1d9-4192-aac6-14fdf80260b8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:36.789968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d86e0-d1d9-4192-aac6-14fdf80260b8 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:36.791570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 29/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:36.797181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:36.798011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:36.798508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:36.827796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:36.829376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:36.845929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0882e7-9a55-4fb1-9663-f52bd798cb44 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:36.846536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0882e7-9a55-4fb1-9663-f52bd798cb44 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:36.847075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0882e7-9a55-4fb1-9663-f52bd798cb44 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:36.848667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 30/63] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:36.853899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:36.854458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:36.854971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:36.883947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:36.885542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:36.916713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 34/64] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:36.959958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.018350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 31/65] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:37.041459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.094457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccdcb4-0bf3-4a42-a086-9968e6d7effa None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.120923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.133501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.134466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.134955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.135407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.146039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-50cf6121-14ca-4b7d-a566-cf4d410533ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:37.151516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:37.152362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:37.153129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:37.155612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 35/66] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:37.157465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d696e6-40b2-403a-ac97-de8f05167e2c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.157929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d696e6-40b2-403a-ac97-de8f05167e2c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.158379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d696e6-40b2-403a-ac97-de8f05167e2c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.160184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 36/67] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:37.161859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d696e6-40b2-403a-ac97-de8f05167e2c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.218970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799579b4-c090-40e7-8f31-37637a6cac40 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.237273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.257587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.258552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.259472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.259954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.274756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c304382d-613e-4158-be77-db346d14d3a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:37.282681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:37.283560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:37.284353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:37.286915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 32/68] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:37.289628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.290056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.290460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.293608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d696e6-40b2-403a-ac97-de8f05167e2c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.316176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:37.317723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:37.337040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.337930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.338358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.338861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.339925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:37.340427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.342052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.352654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 37/69] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:37.353795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.388477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 33/70] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:37.392800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.403979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.458912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16860828-b922-497d-a709-db411e1a65f3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.493071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.493621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.493908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.494190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.494932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:37.495246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.496667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236e0d-c3fc-4dfd-8e6c-86859c391d6e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.502283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab229d-796f-4aaa-9665-30edae3ddf41 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.504877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 38/71] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:37.505882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf2d-475e-4427-8f1a-8eb973927547 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.506170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf2d-475e-4427-8f1a-8eb973927547 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.506456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf2d-475e-4427-8f1a-8eb973927547 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.509772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 39/72] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:37.509772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5495ba-16eb-45e2-afbd-23c4855b1a36 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.509772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5495ba-16eb-45e2-afbd-23c4855b1a36 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.509772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5495ba-16eb-45e2-afbd-23c4855b1a36 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.510045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.514742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 40/73] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:37.514742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5495ba-16eb-45e2-afbd-23c4855b1a36 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.542216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.543361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.543653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.543926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.545099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.546537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.548286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 34/74] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:37.551979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.613819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5495ba-16eb-45e2-afbd-23c4855b1a36 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.620595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.647721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.648366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.648653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.648936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.649243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9768139-83ad-47cd-beea-9b035521f218 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.658932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-71b88a8b-130a-4247-bad3-d584422be81d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:37.664554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:37.665607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:37.666493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 41/75] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:37.667312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.667596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.668522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.686829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:37.688028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:37.694000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.694655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.695042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.695324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.710461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.711960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23bb05-e82b-4aaa-b8d2-d2b810ca4221 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.713640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 35/76] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:37.714846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.715136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.715419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.733118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:37.734340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:37.760048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.763039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 42/77] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:37.763924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.809709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 36/78] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:37.819257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.866993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:37.872544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd9f3f-408e-46ad-b5b1-854addd929e0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.906275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.906928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.907214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.907492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.907873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0a878-3ee4-43e6-9611-63ab5c6da427 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:37.947390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:37.948015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:37.948301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:37.948578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:37.949289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:37.949607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.951115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.962678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 37/79] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:37.963532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:37.979928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:37.981408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:37.989666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.062675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f658-e8a8-4b8a-9cd3-96bdbbe4a6e1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.072335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.078873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 43/80] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:38.084193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.100903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.101532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.101819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.102103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.172139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.173645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.179951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d601-7a15-48c8-b058-39331e1942e0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.196835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.213532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.214586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.214586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.214781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.215881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.217340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.218991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 44/81] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:38.223918 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.279739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 38/82] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:38.279739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.281212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.318794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e64d2-2cc8-4d46-b528-32af28284582 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.352138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.352776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.353060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.353335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.363754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:38.369236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:38.370074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:38.370962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 45/83] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:38.371616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.378993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecde3a-d283-4ae0-8f78-838d35d89470 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.414417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.415139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.415416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.415686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.416837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.418631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.424623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 39/84] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:38.424623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.473986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748b26-794e-4251-9ba8-508762697e02 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.496427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.508005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.508653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.508933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.509211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.510367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.511869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.513652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 46/85] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:38.514411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.520384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1e36-ff1a-4d84-99cf-064e143258da None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.553601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.554225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.554507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.554816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.555529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.557014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.618765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add72c7a-2235-44eb-a8d4-0a00bd38178d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.651774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.652409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.652689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.652989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.654123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.655660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.657353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 47/86] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:38.658109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.669725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 40/87] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:38 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:38.670653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.731263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.742299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.780159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd6af-97cf-4420-9101-8a0d66fd1019 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.801809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5d313-48c0-4447-8074-fafac26f9830 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.822620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.823515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.823798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.824127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.824790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:38.825094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.826492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.836779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 48/88] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:38.837025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:38.846887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:38.847529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:38.847802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:38.848083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:38.931758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:38.933714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:38.969190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad699d-4e32-49e6-aea2-f87a91d5ec50 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:38.998949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:38.999657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:39.015789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.016452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.016743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.017024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.017829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=d5aedfbd59554662a405705e61102c08) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:39.018146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.019907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.027161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 49/89] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/role_assignments?user.id=d5aedfbd59554662a405705e61102c08&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:39.028813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.071217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 41/90] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:39.072585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.163958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82812e7d-a8c4-4b7c-a65e-c0b30de3dbf2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.215112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539abc2-16e4-45b4-ab02-65c6f883ea14 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.263591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.264894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.265469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.266095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.267221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.267847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.268131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.268229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.268546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.270290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:39.270615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.271170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.272088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.273272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 42/91] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:39.274472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.278547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 50/92] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:39.279339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.296872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:39.339326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:39.395165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e32f99-b95a-4c1b-9e3b-fdcea346d459 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.395678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae59db-077a-4207-a0a4-cef4f4498c4a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.433881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.434520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.434851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.435130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.436691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.437556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.438132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.438650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.440096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.441893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.444167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 43/93] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:39.449886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.510817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.512261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.567803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:39.594479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:39.613905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341fed-043c-4611-ba31-06ed4fed74d4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.625676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 51/94] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:39.632514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.654451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.655543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.656018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.656504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.657487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:39.658055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.659937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.666300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 44/95] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=00224db748344c70b18c5c283bc0d81d => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:39.744122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa779ae-dca8-4800-9f2c-d3fea9d09bce None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.782371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.782979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.783259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.783529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] PATH_INFO: `/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.785796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] RBAC: Authorizing `identity:get_project(project_id=8eda29cbd2a64aaf80475465ac2b8cf9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.787307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e4c4-9e1c-4b39-bb25-be3b2c49276d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.789220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 52/96] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:39.795222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:39.906747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323639-86e7-46fe-a1e9-326e11fb1f80 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:39.952845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:39.953484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:39.953770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:39.954048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:39.955105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=8eda29cbd2a64aaf80475465ac2b8cf9, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:39.955422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:39.956930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd88de-40d5-40cc-8d48-d7735d75791d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:39.963515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 45/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:39 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=8eda29cbd2a64aaf80475465ac2b8cf9&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:41.139454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429947c2-4608-44c0-a99d-2e39058c1f2f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:41.139958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429947c2-4608-44c0-a99d-2e39058c1f2f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:41.140033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429947c2-4608-44c0-a99d-2e39058c1f2f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:41.141441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 53/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:41.146753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:41.147526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:41.147967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:41.175839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:41.179038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:41.187529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:41.263386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 46/99] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:41.297979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429947c2-4608-44c0-a99d-2e39058c1f2f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:41.319947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:41.411891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429947c2-4608-44c0-a99d-2e39058c1f2f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:41.447875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:41.448529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:41.448813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:41.449088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:41.459757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:41.464716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:41.465538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:41.466738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 54/100] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:41.472452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:41.594646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127398f-be59-46f6-bfbb-30809cdb6f7c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:41.639880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:41.640565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:41.640852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:41.641195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:41.641849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:41.642200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:41.644158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:41.658205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 47/101] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:41.663976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:41.751133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:41.775266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e75d-a0a7-4c2f-85b6-6f859e66ec01 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:41.812027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:41.812679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:41.812962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:41.813240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] PATH_INFO: `/v3/users/15dfb81baaf8401babc228bf79f6c763` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:41.828933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] RBAC: Authorizing `identity:get_user(user_id=15dfb81baaf8401babc228bf79f6c763)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:41.830419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:41.832302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 55/102] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:41 2022] GET /identity/v3/users/15dfb81baaf8401babc228bf79f6c763 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:41.837954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:41.841979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:41.964541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd461b6-465d-4881-b13b-0c647d4f98b4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:42.008329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:42.008968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.009254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.009534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.097938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:42.099450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c304a-e66f-42fd-bdf8-833983d26798 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:42.107764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:42.234987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 48/103] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:42.240952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:42.307104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179b2b-b933-439f-84cc-72ae3e3d18e1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.307435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179b2b-b933-439f-84cc-72ae3e3d18e1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.307651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179b2b-b933-439f-84cc-72ae3e3d18e1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.309286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 49/104] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:42.314141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752dee-5563-4101-b14a-840f9d9affe6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.314422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752dee-5563-4101-b14a-840f9d9affe6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.314692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752dee-5563-4101-b14a-840f9d9affe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.343790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2c752dee-5563-4101-b14a-840f9d9affe6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:42.345011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c752dee-5563-4101-b14a-840f9d9affe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:42.369363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7546e-949c-4c1c-b944-275988fd3289 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:42.406586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:42.407664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.408099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.408654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.410468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:42.412748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:42.415211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 56/105] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:42 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:42.421393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:42.435058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:42.536692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9cccb-c87e-4ce7-ae81-d8943998adad None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:42.548054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 50/106] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:42.549363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91ff3-fb42-4577-ab67-a9460beb773c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.549654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91ff3-fb42-4577-ab67-a9460beb773c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.550564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91ff3-fb42-4577-ab67-a9460beb773c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.552203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 51/107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:42.557877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869846-cac3-4ae2-ae70-8171dfc8beac None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.558169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869846-cac3-4ae2-ae70-8171dfc8beac None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.558452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65869846-cac3-4ae2-ae70-8171dfc8beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.574947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:42.575803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.576328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.576839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.577809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=15dfb81baaf8401babc228bf79f6c763) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:42.578256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:42.579991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8aa6bb-96b8-4005-b29e-15d79e78ebd3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:42.586976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 57/108] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:42 2022] GET /identity/v3/role_assignments?user.id=15dfb81baaf8401babc228bf79f6c763&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:42.588466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820976a-74b1-4964-8f8c-41b5941520d4 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.588891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820976a-74b1-4964-8f8c-41b5941520d4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.590781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820976a-74b1-4964-8f8c-41b5941520d4 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.595178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-65869846-cac3-4ae2-ae70-8171dfc8beac None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:42.595839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 58/109] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:42.596390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-65869846-cac3-4ae2-ae70-8171dfc8beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:42.596520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820976a-74b1-4964-8f8c-41b5941520d4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:42.626897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:42.720760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 52/110] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:42.722447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2f16-b74d-45dc-9169-85159f330bfe None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.722890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2f16-b74d-45dc-9169-85159f330bfe None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.723177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab2f16-b74d-45dc-9169-85159f330bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.742302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:42.751671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a3ab2f16-b74d-45dc-9169-85159f330bfe None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:42.752884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a3ab2f16-b74d-45dc-9169-85159f330bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:42.793957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820976a-74b1-4964-8f8c-41b5941520d4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:42.838734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 53/111] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:42.840023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c6bd-7c9c-44b5-a492-18eeb852cc38 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.840306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c6bd-7c9c-44b5-a492-18eeb852cc38 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.840576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8c6bd-7c9c-44b5-a492-18eeb852cc38 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.842029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 54/112] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:42.846241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8c6bd-7c9c-44b5-a492-18eeb852cc38 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:42.851349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:42.852279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.852736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.853743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.855183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:42.857717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bae41-e8b6-423e-a577-a1136991dc38 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:42.860127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 59/113] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:42.862012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:42.862784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:42.863265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:42.886623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:42.888159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:42.957870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:42.973215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8c6bd-7c9c-44b5-a492-18eeb852cc38 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:42.987489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 60/114] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:42.989676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.031556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.032549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.033082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.033580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.044681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:43.050355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:43.051259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:43.052020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:43.054442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 55/115] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:43.055468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.085824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.129977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa256373-db77-48b1-8f5b-269a377cec70 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.174203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.175393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.175681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.175958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.176696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.178652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.192737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d22f3-b5c5-40eb-a100-72fc27abeed2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.229894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.230546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.231009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.231293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.242828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:43.247819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:43.281810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 56/116] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:43.282810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.283666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.306068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 61/117] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:50:42 2022] POST /identity/v3/projects => generated 302 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:43.307531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.370257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f125-0cfd-4426-a987-7e91429e49a3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.407565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.408233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.408519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.408798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.421886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-96b2ae6b-e0ad-4ab1-852b-fd3e46c6b184 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:43.427583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:43.428511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:43.429322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:43.433864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 57/118] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:43.435326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aeb5-f468-4c8e-a21b-11b3d509b682 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.435621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aeb5-f468-4c8e-a21b-11b3d509b682 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.435914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7aeb5-f468-4c8e-a21b-11b3d509b682 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.441445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 58/119] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:43.441445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7aeb5-f468-4c8e-a21b-11b3d509b682 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.470390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456977c0-78b6-489f-b6f9-792dd470ddb6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.498557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.515819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.516458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.516740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.517027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.517817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:43.518133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.520588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.525295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.531199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 62/120] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:43.532034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.556031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7aeb5-f468-4c8e-a21b-11b3d509b682 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.607536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.608378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.608666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.609210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.610274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:43.610752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.613080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49e9a5-69d8-4225-8445-5e310e395a86 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.624637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 59/121] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:43.625860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.626982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.627273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.648864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:43.650608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:43.658979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad6d9-8296-4c8f-9350-1706510693cf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.704318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.705174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.705603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.706129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.707201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:43.707783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.709449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.725437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 63/122] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:43.726990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.751700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 60/123] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:43.752566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.801882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.832733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:43.870392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c39bd-7710-48da-a3bb-4ab38697b2ad None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.875293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8bc6-fa4f-44c3-92d1-07b09d6c8557 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:43.908814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.909844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.910329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.910833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.912573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.914247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.916109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 64/124] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:43.916806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:43.917335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:43.917561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:43.918114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:43.918394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:43.919693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:43.921202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:43.924076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 61/125] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:43.924734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.041011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c78b41-3cf4-47c0-9663-59a0e8287005 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.045280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650ca8a-42a2-4e94-a3d6-aa0b7454ccbe None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.058295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.080647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.081690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.082236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.082749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.084929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.087155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.088657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.088944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.089226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.090419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.092368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.097927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:44.098992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 65/126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.099932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:44.104323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:44.105387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:44.106401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:44.110730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 62/127] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:50:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:44.114897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.205285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1c27-3de4-45e9-811e-58123b2569b0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.228951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ea15b-54c5-4ded-8c81-e6183f3f0432 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.240984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.241640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.241925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.242208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.243861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.245310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.247015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 66/128] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.247783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.268945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.269791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.270085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.270508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.271782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.273407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.275375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 63/129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.276198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.297146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.347371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.352627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dbbf1-cad4-4adf-b892-bd53e277d459 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.388898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.389605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.389961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.390314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] PATH_INFO: `/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.391577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] RBAC: Authorizing `identity:get_project(project_id=8eda29cbd2a64aaf80475465ac2b8cf9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.392478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbc3a-0d4f-4893-8df1-380264ab92ea None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.393185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.395089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 67/130] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.396103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.432691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.433734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.434199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.434653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.435625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:44.436108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.437977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.447705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 64/131] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.449002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.505502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb7669-2fad-4cd1-8d6d-3bc68ff9cc2d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.520225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.541123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.541811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.542095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.542400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/d5aedfbd59554662a405705e61102c08/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.544649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, user_id=d5aedfbd59554662a405705e61102c08, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.546097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.566346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce401b-6d2b-4c53-81c6-5c7baa6fcc74 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.593620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:44.605663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.606350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.606635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.606946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.608891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, user_id=0ad0a36cb2094e56afa21fbf052c8ccd, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.610335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.646746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 68/132] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:44 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/d5aedfbd59554662a405705e61102c08/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:44.646746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.728734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 65/133] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:44 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:44.729984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.806481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eb865-3220-4612-a622-93e5d920d6a3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.862251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.863956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.864307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.864593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] PATH_INFO: `/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.866804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] RBAC: Authorizing `identity:create_grant(project_id=8eda29cbd2a64aaf80475465ac2b8cf9, user_id=0ad0a36cb2094e56afa21fbf052c8ccd, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.868296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7952-4d24-4260-9d31-07742f9137bd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.902451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4342d-6691-4b2f-b422-0548267397c4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:44.943764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:44.944843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.945397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.945890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.947815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:44.948368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 69/134] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:44 2022] PUT /identity/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:44.949777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51288-e6c5-4521-9434-083a108161fb None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.950143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51288-e6c5-4521-9434-083a108161fb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.950364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd51288-e6c5-4521-9434-083a108161fb None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.951632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 70/135] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:44.952282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:44.956149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 66/136] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:44.958126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:44.958416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:44.958699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:44.963063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:44.998855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:45.000159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:45.051081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:45.063178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:45.139864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0fbdf-ac4f-4a1e-b871-cb567719e5c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.145210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 71/137] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:45.180624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:45.209621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.210301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.210585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.210894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.212391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:45.213899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:45.226748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 67/138] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:44 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:45.233050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:45.341598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72988b0d-262e-48ce-9162-20aaa38c6fe5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.377207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.377871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.378179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.378457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.380880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8068e-1129-49a4-be6c-3ec2be69dee5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.392023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:45.397814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:45.398678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:45.399497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 72/139] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:45.405082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:45.420794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:45.434905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:45.450484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.451198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.451480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.451760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.463593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, user_id=0ad0a36cb2094e56afa21fbf052c8ccd, role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:45.465078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:45.528250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4504372-711a-4c45-a0e6-d452de893237 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.561535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 68/140] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:45 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/0ad0a36cb2094e56afa21fbf052c8ccd/roles/00224db748344c70b18c5c283bc0d81d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:45.579065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.579699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.579980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.580258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.580984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:45.582049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:45.583495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:45.593168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 73/141] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:45.608523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:45.749249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7d5e-b29d-4366-b47e-07706cbe161f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.799432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.800205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.800823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.800823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] PATH_INFO: `/v3/users/15dfb81baaf8401babc228bf79f6c763` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.802033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] RBAC: Authorizing `identity:get_user(user_id=15dfb81baaf8401babc228bf79f6c763)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:45.803569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:45.805196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 69/142] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:45 2022] GET /identity/v3/users/15dfb81baaf8401babc228bf79f6c763 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:45.811014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:45.910332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:45.926159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f4b2-8266-46d4-a33e-e2a52de37cba None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:45.961380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:45.962039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:45.962322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:45.962600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:45.963794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:45.965249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db032f-8833-40db-a57a-bdc6bcae74ff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:45.971033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 74/143] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:45 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:45.973602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:46.032543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:46.092067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a341d56-2f2a-4f6e-b026-c8b0b60e78e9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:46.136884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:46.137570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:46.137854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:46.138132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/15dfb81baaf8401babc228bf79f6c763/roles/5a5cf9961dfc49f6a5758575f7c815fe` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:46.140177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, user_id=15dfb81baaf8401babc228bf79f6c763, role_id=5a5cf9961dfc49f6a5758575f7c815fe)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:46.141636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:46.176995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a877e34-4dbb-4456-9815-2e068a536e73 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:46.177274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a877e34-4dbb-4456-9815-2e068a536e73 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:46.177479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a877e34-4dbb-4456-9815-2e068a536e73 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:46.178879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 75/144] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:46.189707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:46.189998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:46.190272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:46.213339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:46.214568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:46.262954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 70/145] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:45 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/users/15dfb81baaf8401babc228bf79f6c763/roles/5a5cf9961dfc49f6a5758575f7c815fe => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:50:46.311430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 76/146] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:46.336704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:46.475947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b36b79-076b-4425-abac-9508cd47ec1d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:46.491427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:46.523179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:46.523836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:46.524119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:46.524398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:46.525563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:46.527101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4945f8-f33a-4be6-9402-3796edf5bf9e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:46.529006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 71/147] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:46.536052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:46.658105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:46.680084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c950e-c5d1-4402-966b-62c39a2e980b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:46.727262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:46.727811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:46.728093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:46.728369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:46.729063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:46.730522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec601d2-ae09-481b-a190-4db71ac38472 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:46.860090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 77/148] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:46 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:47.775063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0da8-a772-4031-a9a8-7d6de6f97ef0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:47.775604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0da8-a772-4031-a9a8-7d6de6f97ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:47.775604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0da8-a772-4031-a9a8-7d6de6f97ef0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:47.777258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 72/149] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:47.782307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29738b-8735-43b9-9e33-c49a007e19a4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:47.782762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29738b-8735-43b9-9e33-c49a007e19a4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:47.782962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29738b-8735-43b9-9e33-c49a007e19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:47.807764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cc29738b-8735-43b9-9e33-c49a007e19a4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:47.809284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cc29738b-8735-43b9-9e33-c49a007e19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:47.885601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 78/150] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:47.919769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0da8-a772-4031-a9a8-7d6de6f97ef0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:47.934081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae5f-15f2-4f02-89b7-0725e2516f1c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:47.934698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae5f-15f2-4f02-89b7-0725e2516f1c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:47.935209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aae5f-15f2-4f02-89b7-0725e2516f1c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:47.936802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 79/151] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:47.942248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bbe3-d42f-433e-9f93-6f1c3c1a01a8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:47.942821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bbe3-d42f-433e-9f93-6f1c3c1a01a8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:47.943316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bbe3-d42f-433e-9f93-6f1c3c1a01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:47.964582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f2f6bbe3-d42f-433e-9f93-6f1c3c1a01a8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:47.965702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2f6bbe3-d42f-433e-9f93-6f1c3c1a01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:48.101887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:48.105972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 80/152] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:48.107256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d088cc-bb98-4d6f-9eeb-5bdb8cfe25a0 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.107548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d088cc-bb98-4d6f-9eeb-5bdb8cfe25a0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.107829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d088cc-bb98-4d6f-9eeb-5bdb8cfe25a0 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.109113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 81/153] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:48.117116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.117405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.122065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.122177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0da8-a772-4031-a9a8-7d6de6f97ef0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:48.163377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:48.164584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:48.201423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:48.202082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.202883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.203184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.220675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:48.227174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:48.228084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:48.228905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:48.229524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 73/154] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:48.230084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.274009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:48.325061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 82/155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:48.326002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.358796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d96e-ec4f-4bae-8b27-13aebd976c33 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:48.429675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:48.430336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.430673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.430918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.452836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:48.458343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:48.460539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 74/156] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:48.462520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.561027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10809-6629-4dac-9e12-67a766fc37d8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:48.615964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:48.625768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:48.626393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.626666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.626973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.627824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:48.630418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:48.631944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:48.637566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:48.652518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666fa3f-9663-4be7-a1e5-706db25de95a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:48.656223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 83/157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:48.656898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.724013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:48.725064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.725553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.726034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.755427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5bf9eed3-6a60-44e0-a275-79aaf84ec969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:48.761052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:48.761988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:48.762816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:48.765254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 75/158] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:48.774735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b194d-1cc9-40fc-abd1-1e262edf3788 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.775387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b194d-1cc9-40fc-abd1-1e262edf3788 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.776320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b194d-1cc9-40fc-abd1-1e262edf3788 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.777892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 76/159] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:48.778836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b194d-1cc9-40fc-abd1-1e262edf3788 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.875440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb5ae-fe86-4881-9306-c4571392b15a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:48.933870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:48.934493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:48.934791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:48.935063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:48.935834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:48.936133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:48.937967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:48.954160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 84/160] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:48.956628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:48.999945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b194d-1cc9-40fc-abd1-1e262edf3788 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.078233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.082675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.083215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.083702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] PATH_INFO: `/v3/users/d5aedfbd59554662a405705e61102c08` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.085187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aedfbd59554662a405705e61102c08)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.091078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19263-b66b-44fe-a69b-950f02947914 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.093278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 77/161] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/users/d5aedfbd59554662a405705e61102c08 => generated 247 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:49.093766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.095815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.096301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.097346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.135849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:49.137500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:49.175924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.217671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3b58-174a-4603-9455-1fe94ceb82f7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.260896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 78/162] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:49.262595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.290884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.290884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.290884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.290884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.291292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:49.291292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.295868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.317290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 85/163] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:49.318144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.399239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbeaff3-80c4-4f27-91fd-a322f2db5ae0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.435817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.436990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.437469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.437971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.439411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.441878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156f1c0-8aae-4dca-872b-8178c5eda223 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.443912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 79/164] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:49.445363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae4439-f13b-47a0-94a5-0e66decc9151 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.445862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae4439-f13b-47a0-94a5-0e66decc9151 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.446337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae4439-f13b-47a0-94a5-0e66decc9151 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.447779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 80/165] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:49.448664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae4439-f13b-47a0-94a5-0e66decc9151 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.482730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.557370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae4439-f13b-47a0-94a5-0e66decc9151 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.617060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.618076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.618555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.619161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.620541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.622381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.624496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 81/166] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:49.625987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.641362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d39159-3770-4196-aad6-cbe75d08eb7b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.672477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.717003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.717638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.717916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.718191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.751557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:49.760623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a03d2-112c-4691-9df6-5f9360586dc6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:49.839249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:49.839893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.840160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.840437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:49.867699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:49.868738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:49.870278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317845a-35e0-47b7-852c-d85effa01989 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:49.872725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:49.873590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:49.874391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 82/167] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:49.875163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:49.991372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 86/168] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:49.992560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:49.992846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:49.993122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.017687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:50.019138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:50.030493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.090337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 87/169] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:50.091274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.190379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851c9b-784f-4cf2-9ef9-1d4e6718e3d9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.197813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa381-4731-4bc5-8025-b8e7dabf5990 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.231428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.232400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.232873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.233209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.233581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.233827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.234108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.234381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.251119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.256391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.307370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.308435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.308849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.310394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.414304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 88/170] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:50.415229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.418430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 83/171] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:50.419988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.463746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.475135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.519506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563db3dd-a4e1-419c-a853-f2f8cca13d5e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.527811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b4b5-69e5-41b9-9a69-75f365bb71bb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.555798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.556358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.556636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.556909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.557631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:50.557920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.559517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.568652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 89/172] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:50.569495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.570131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.571055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.571613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.572077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.573475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.575327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405874f2-fd71-4f9e-9dc1-a5638b17b5b2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.577342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 84/173] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:50.578915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09db01-d3a4-412e-bb4f-1bd18627e0ec None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.579393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09db01-d3a4-412e-bb4f-1bd18627e0ec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.579945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09db01-d3a4-412e-bb4f-1bd18627e0ec None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.581404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 85/174] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:50.582346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09db01-d3a4-412e-bb4f-1bd18627e0ec None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.686855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c450-6b48-4f0a-9173-3918c7a3428b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.700413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.706057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09db01-d3a4-412e-bb4f-1bd18627e0ec None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.722998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.726555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.726555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.726555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.726799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.735331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:50.741404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:50.742333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:50.743392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 90/175] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:50.744400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.747671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.748949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.749836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.750250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] PATH_INFO: `/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.751648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] RBAC: Authorizing `identity:get_project(project_id=8eda29cbd2a64aaf80475465ac2b8cf9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.754672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.757067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 86/176] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/projects/8eda29cbd2a64aaf80475465ac2b8cf9 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:50.757645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.856302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064c1f-67f9-4c92-bd1b-377385483257 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.864112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceda57-2e2e-4e9a-874c-968c01bcae1d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:50.898033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f6349-2914-49d9-9007-86869c64131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.898679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6349-2914-49d9-9007-86869c64131c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.898985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6349-2914-49d9-9007-86869c64131c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.899256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f6349-2914-49d9-9007-86869c64131c None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.900467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f6349-2914-49d9-9007-86869c64131c None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.901812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:50.901975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f6349-2914-49d9-9007-86869c64131c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.902458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.902762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.903042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] PATH_INFO: `/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.903597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 91/177] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:50.904365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] RBAC: Authorizing `identity:get_user(user_id=0ad0a36cb2094e56afa21fbf052c8ccd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:50.905797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:50.912207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 87/178] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/users/0ad0a36cb2094e56afa21fbf052c8ccd => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:50.912207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:50.912438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:50.912438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:50.912438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:50.928966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:50.930133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:50.957857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.964409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:50.996762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 92/179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:50.997743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.010471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16dbcd-61ab-4196-bdeb-34e0bfafbd3a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.045564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.046193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.046473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.046775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.047568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=d5aedfbd59554662a405705e61102c08) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:51.047877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.049696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6b0be-622b-465a-a1fc-c7f6bf896616 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.056200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 88/180] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/role_assignments?user.id=d5aedfbd59554662a405705e61102c08&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.057375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9942-5cd5-4672-be9d-4ad1409b5508 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.057657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9942-5cd5-4672-be9d-4ad1409b5508 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.057930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc9942-5cd5-4672-be9d-4ad1409b5508 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.059412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 89/181] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:51.060291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc9942-5cd5-4672-be9d-4ad1409b5508 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.109817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f81c09-8c60-4d7d-8078-ca722300d8b5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.149439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.150079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.150357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.150628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.151379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:51.151682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.153381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd1242-aa0f-432e-8502-54da67238785 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.163911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 93/182] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.165236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419b4e-bec8-44cf-a260-b39429a8f1e5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.165522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419b4e-bec8-44cf-a260-b39429a8f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.165800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa419b4e-bec8-44cf-a260-b39429a8f1e5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.171390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 94/183] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:51.171390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419b4e-bec8-44cf-a260-b39429a8f1e5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.185998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc9942-5cd5-4672-be9d-4ad1409b5508 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.205672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.206337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.228435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.229168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.229528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.229724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.230518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=8eda29cbd2a64aaf80475465ac2b8cf9, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:51.230868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.232322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.239288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 90/184] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=8eda29cbd2a64aaf80475465ac2b8cf9&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.240102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.306613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa419b4e-bec8-44cf-a260-b39429a8f1e5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.347543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.348147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.348428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.348703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.349506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:51.349814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.351321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.363363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 95/185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.363363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.375835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eb923-ae5a-4547-a31f-a9cd91377183 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.437574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.439972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.440524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.441009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.500829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.512245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.517050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc519-2434-466d-8a92-5ec12b2f0399 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.539809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.541926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.559379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.560120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.560414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.560676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.577454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-815943e1-784d-4de0-bf1c-adaf898776d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:51.583439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:51.584327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:51.585565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 96/186] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:51.586247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ea7-fe40-4edd-8ebe-1c256643c540 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.586247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ea7-fe40-4edd-8ebe-1c256643c540 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.586725 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba925ea7-fe40-4edd-8ebe-1c256643c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.606465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ba925ea7-fe40-4edd-8ebe-1c256643c540 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:51.607691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ba925ea7-fe40-4edd-8ebe-1c256643c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:51.653314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 91/187] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:51.654070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.675474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 97/188] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:51.676826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.677095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.677368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.695424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:51.696606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:51.742998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.760513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0122b48-cd52-4f6c-8fa7-f35c18884c5d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.764498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 98/189] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:51.771513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.785718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.796617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.797257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.797534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.797810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] PATH_INFO: `/v3/users/15dfb81baaf8401babc228bf79f6c763` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.799007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] RBAC: Authorizing `identity:get_user(user_id=15dfb81baaf8401babc228bf79f6c763)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.800468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.802070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 92/190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/users/15dfb81baaf8401babc228bf79f6c763 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.802844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.871041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c418e4-edc3-49d0-9caf-30dc321abe21 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.903617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897b394-2df7-4e9c-baf4-7f47eed147b1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:51.905131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.905753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.906028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.906307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.907051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:51.907360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.908741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.916906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 99/191] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.918052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.937359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:51.938083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:51.938369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:51.938644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:51.939818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:51.941847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:51.943534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 93/192] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:51.944294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:51.965090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:51.996622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.021542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb15e7c-b54d-4c75-9384-a3480aaa0276 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.044235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7caad9-8e6a-41cd-9049-75908da0204f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.058054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.058685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.058996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.059265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.069884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:52.075198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:52.076211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:52.077018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 100/193] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:52.077685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.085418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.086063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.086340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.086610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.087789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.089227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.090990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 94/194] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:52.091564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.176302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.182935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cc2fc-b618-4524-af94-799dafe5900b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.191234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a036b-5eca-4f0c-8f1f-9c2b07886ee3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.223922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.224702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.225361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.225641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.238522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.240018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.241651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 95/195] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:52.242405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.272935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.273554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.273830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.274102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.276925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.339704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a590a-98d7-4208-867b-f10041a9a680 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.342083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.343589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.373189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.373801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.374080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.374355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.375178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=0ad0a36cb2094e56afa21fbf052c8ccd) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:52.375489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.376922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.383200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 96/196] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/role_assignments?user.id=0ad0a36cb2094e56afa21fbf052c8ccd&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=00224db748344c70b18c5c283bc0d81d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:52.383982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.399526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.453492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 101/197] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:52.454354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.494725 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.500706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d86d02-5b2f-4f22-b455-60d9c99ebe5f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.536864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.537487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.538774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.538774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.538774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:52.539079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.540437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.550767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 97/198] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:52.551514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.575456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f238f-1b93-4672-b308-5f127591e20a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.615881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.616512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.616791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.617072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.617755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.619338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.628833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.658226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067fed-200e-4d42-ad96-3d17b8645614 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.691247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.691899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.692184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.692456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.758799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 102/199] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:52 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:52.758799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.761770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.763773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.842346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.860437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:52.872789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc05224-4a09-46dd-8fde-2b92637edc91 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:52.879751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 98/200] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:52.880625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:52.926484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:52.927210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:52.927546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:52.927797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:52.929144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:52.930642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:52.932552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 103/201] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:52.933363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.001073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19308cb-3e2a-4dbc-8a80-966970e78c47 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.047714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.048369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.048642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.048911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.050835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.052814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.054468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 99/202] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:53.055377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.065016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202785d3-fb2a-401e-b792-e8969c5c1235 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.103448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:53.112992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.113656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.113940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.114236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.115551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.117012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.118964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 104/203] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:52 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:53.119621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.152796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:53.180343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac250da-67bc-4510-a32b-6793551de7c1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.219554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.220311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.220660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.221003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.222261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2, user.id=15dfb81baaf8401babc228bf79f6c763) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:53.222648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.224310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.231095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 100/204] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:53 2022] GET /identity/v3/role_assignments?user.id=15dfb81baaf8401babc228bf79f6c763&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:53.232278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.251954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d60f80-d03b-49cd-8f7a-b66b6aaf81fe None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.293337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.294361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.294891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.295388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.385443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.391053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.439956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:53.470076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62214c7-c925-4b9e-aff9-5b585b73a54f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.472290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:53.516451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.517843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.518323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.519369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.520467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=e366c63aa681486a8e8b4d5a0de55a00) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:53.521546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.523729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.532975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 101/205] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:53 2022] GET /identity/v3/role_assignments?user.id=e366c63aa681486a8e8b4d5a0de55a00&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:53.538774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 105/206] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:53.545285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.669416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d4d0-c21f-42d4-8fab-4da42d9362df None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.711860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.712516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.712793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.713146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.714322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.715794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d372902-8ef1-4972-a334-79174fdd41aa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.717475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 102/207] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:53 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:53.727844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:53.831455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac55c4-e49e-4b8e-bf06-f77f116a0dcb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:53.857190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:53.866369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:53.867026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:53.867307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:53.871976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:53.871976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=e366c63aa681486a8e8b4d5a0de55a00) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:53.871976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:53.871976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a36b3-1e34-4f2c-afa3-810aa47eb498 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:53.876251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 106/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:53 2022] GET /identity/v3/role_assignments?user.id=e366c63aa681486a8e8b4d5a0de55a00&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=00224db748344c70b18c5c283bc0d81d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:55.036236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669704-496a-47a5-8d42-a6d6ef29d4b5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.036736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669704-496a-47a5-8d42-a6d6ef29d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.036813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669704-496a-47a5-8d42-a6d6ef29d4b5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.038440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 103/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:55.044523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.044964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.045057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.048234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84cd-2278-4ac9-baa2-3b24882c9a84 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.048724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84cd-2278-4ac9-baa2-3b24882c9a84 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.049212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f84cd-2278-4ac9-baa2-3b24882c9a84 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.051032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 104/210] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:55.057383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a15ce-b564-431a-9a89-febcd5083add None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.057899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a15ce-b564-431a-9a89-febcd5083add None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.058370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a15ce-b564-431a-9a89-febcd5083add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.064257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:55.065831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.076964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-278a15ce-b564-431a-9a89-febcd5083add None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:55.078385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-278a15ce-b564-431a-9a89-febcd5083add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.106852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.148229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 105/211] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:55.153391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 107/212] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:55.172622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a15ce-b564-431a-9a89-febcd5083add None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.181739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.277515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a15ce-b564-431a-9a89-febcd5083add None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.310011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e44d-800e-4547-bde2-685bfdf1362a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.313814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.314632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.315085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.315612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.326583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:55.332397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:55.333483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:55.334413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:55.335061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.336759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 106/213] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:55.347152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.350948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.351632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.351873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.352143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.353286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.355235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.357829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 108/214] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:55.362828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.388727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.465663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471701c-9f7a-4cfd-9664-debefd260662 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.494167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68791-9afe-46d0-97ea-2021c6942302 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.505919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.506680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.507082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.507452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.508321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:55.508718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.510323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.519983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 107/215] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:55.525498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.540840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.541500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.541803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.542081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.543059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.544503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be134f0-6ed7-4ca9-a849-99072665a996 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.618085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.632963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c52d4-58d2-4247-a70d-e25ad72cacfe None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.653236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 109/216] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:55 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:50:55.654622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7680d-adf0-4dc0-8b93-a0d691407ee9 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.654943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7680d-adf0-4dc0-8b93-a0d691407ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.655211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7680d-adf0-4dc0-8b93-a0d691407ee9 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.656764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 110/217] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:55.662618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.663009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.663290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.680837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.681963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.682438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.682999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] PATH_INFO: `/v3/users/42db884571bf4e81853d901aa851ff98` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.683731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:55.685098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:55.702315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=42db884571bf4e81853d901aa851ff98)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.704861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.708882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 108/218] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/users/42db884571bf4e81853d901aa851ff98 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:55.718733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.738306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.772895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 111/219] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:55.795439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:55.857540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a609-45f1-4bd0-8048-6be7ec17b2e2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.905009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.906125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.906406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.906679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.924591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:55.937292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad83a8c-fcd4-4105-b1a7-29b63cc1fba6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:55.983915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:55.984575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:55.984863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:55.985132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:55.991791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:55.994601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41510fdd-da31-4664-a665-8a4482ea0bb4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:55.997304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9608f008-5968-4bb0-a1cd-e15793322126 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:56.003723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:56.005122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:50:56.006069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 112/220] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:50:56.007244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618bfd-3b3a-4bdf-9c87-57c9269106a7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.007436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618bfd-3b3a-4bdf-9c87-57c9269106a7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.008823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0618bfd-3b3a-4bdf-9c87-57c9269106a7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.011667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 113/221] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:56.015783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0618bfd-3b3a-4bdf-9c87-57c9269106a7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.060285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.110768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 109/222] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:56.112083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.113034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.113225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.131367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0618bfd-3b3a-4bdf-9c87-57c9269106a7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.132612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:56.133877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:56.168691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.169698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.170159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.170620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.171573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:56.172055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.173672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.178198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.184679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 114/223] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:56.185956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.210736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 110/224] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:56.210736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.311831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf7659-2e02-412e-9411-df46df98cdf8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.312991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f430cc-ded0-4c09-bd06-8b8b8881344a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.343174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.355564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.356785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.357241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.357652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.359211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.360254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.360999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.361138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.361467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.361840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.363881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.364397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 111/225] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:56.365520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.365733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.367547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 115/226] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:56.371249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.420195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.493042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d2de3-fd63-4e58-98d6-0d4ecf4e4a88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.499079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e4b39-b201-4371-b6b5-51890a60e71a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.536395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.537030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.537435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.537621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.542449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.543922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.544510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.544931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.546868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.548472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.549635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:56.551131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 116/227] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:56.552132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:56.555538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:56.556679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:50:56.557693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:56.564205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 112/228] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:56.565572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.591015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.664792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d735a-cf9f-4566-a9cc-5368cd832ba4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.701633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.702373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.702797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.703148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.704032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=42db884571bf4e81853d901aa851ff98) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:56.704436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.706037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.711862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 117/229] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/role_assignments?user.id=42db884571bf4e81853d901aa851ff98&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:56.712224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d7e42-50ba-46c8-92f6-b04540c9cfd0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.713013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:56.714209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.757443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.758294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.758779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.759269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/e366c63aa681486a8e8b4d5a0de55a00/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.761567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, user_id=e366c63aa681486a8e8b4d5a0de55a00, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.763227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.836428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:56.843406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c471dd8-4c99-4d19-85ba-df98cc1a4ca8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:56.852142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 113/230] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:56 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/e366c63aa681486a8e8b4d5a0de55a00/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:56.902344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:56.903034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:56.903316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:56.903593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:56.904317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:56.904623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:56.906015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:56.916228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 118/231] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:56.922375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:57.047890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3626a5b-c4b6-4d5b-bba8-ab90fe36177c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:57.109572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:57.110235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:57.110519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:57.110815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:57.112070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:57.114133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:57.116177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 114/232] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:56 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:57.121608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:57.275216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65587b-7c02-4b64-b12e-897401d1fbd6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:57.310255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:57.310922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:57.311205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:57.311481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:57.312663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:57.314096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328189ca-a6ba-4831-80f9-228a0f4020e2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:57.316482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 119/233] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:57 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:57.321854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:57.397933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:57.501517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379b639-1e27-48cc-9879-0508ff3203f6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:57.546284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:57.547009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:57.547290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:57.547567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/e366c63aa681486a8e8b4d5a0de55a00/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:57.549808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, user_id=e366c63aa681486a8e8b4d5a0de55a00, role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:57.551307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3229ab-3983-4d48-a679-77b34d0df5de None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:57.630726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 115/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:50:57 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/e366c63aa681486a8e8b4d5a0de55a00/roles/00224db748344c70b18c5c283bc0d81d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:50:58.086138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719de1-b8fd-4bcb-b199-558412f49629 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.086528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719de1-b8fd-4bcb-b199-558412f49629 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.086704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719de1-b8fd-4bcb-b199-558412f49629 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.088386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 120/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:58.093607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.093889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.094162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.116268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:58.117472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:58.197929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 116/236] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:58.227469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795099-ee32-4495-9548-9db481cc8f6f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.228421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795099-ee32-4495-9548-9db481cc8f6f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.228903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795099-ee32-4495-9548-9db481cc8f6f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.230487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 121/237] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:58.232075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.252287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.252962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.253444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.276470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.286476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:58.288290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:58.335119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.411105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 122/238] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:50:58.423978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46518c93-64aa-4b35-a5c6-f43aaf025ea5 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:58.474035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:58.474691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.475005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.475282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.478196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.504353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:58.512386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:58.513279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:58.514092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 117/239] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:58.521506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.617988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.639771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de1a1-bcbe-4adb-98cd-faa2cfd5ce5a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:58.678764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:58.679714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.680215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.680686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.681597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:58.682128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:58.683722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:58.685022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33113ad-754a-4f5d-845a-14652b938f09 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:58.697886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 118/240] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:58.703690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.736373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:58.737423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.738007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.738558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.740390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:58.742404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:58.744563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 123/241] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:50:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:50:58.749731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:58.780186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.910201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0039da-08eb-4feb-93f8-13f0741ae946 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:58.929647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557becc2-a782-48d8-abce-b42d617a26a3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:58.979757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:58.980772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.981310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.981782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] PATH_INFO: `/v3/users/c95c0de1c002403fa650d70055fe35f9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.991427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:58.992062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:58.992338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:58.992608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:58.993312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:58.994769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c9a8-9b9b-4f3c-a6de-f17e029e5b49 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:58.995807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:58.999115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] RBAC: Authorizing `identity:get_user(user_id=c95c0de1c002403fa650d70055fe35f9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.000764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.003666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 119/242] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:58 2022] GET /identity/v3/users/c95c0de1c002403fa650d70055fe35f9 => generated 297 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:59.009075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.121657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d85973-8fc4-4b76-8b7e-499a7250259f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.144592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 124/243] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:50:58 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:50:59.152694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368dd0e-4330-4398-8bcb-f26259d7aa24 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.153413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368dd0e-4330-4398-8bcb-f26259d7aa24 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.153959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368dd0e-4330-4398-8bcb-f26259d7aa24 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.160681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 125/244] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:50:59.162899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136bf5-151a-404f-8015-82b123c44d48 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.163438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136bf5-151a-404f-8015-82b123c44d48 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.163946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb136bf5-151a-404f-8015-82b123c44d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.174689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.175907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.176249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.176523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.185535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fb136bf5-151a-404f-8015-82b123c44d48 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:59.187102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fb136bf5-151a-404f-8015-82b123c44d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:59.256413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.259398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.261126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.350811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 126/245] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:59.352166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817e14-6f5c-458f-bbdc-7585bddf2ac5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.352451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817e14-6f5c-458f-bbdc-7585bddf2ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.352751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817e14-6f5c-458f-bbdc-7585bddf2ac5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.354204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 127/246] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:50:59.366076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.366748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.367247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.381066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 120/247] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:50:59.382446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.388402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:50:59.389917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:50:59.395138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.472830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 128/248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:50:59.474247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.510700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.513808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe3ad-5b78-49dc-b066-af9f4a1a7fe1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.558615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.559306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.559587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.559863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.571383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:59.577292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:59.578228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:59.579059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 121/249] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:59.579718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.609853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148a58-96d0-4822-a630-332fec2e2de7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.654834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.655491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.655809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.656098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.657350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.659643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.661803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 129/250] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:59.662657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.676894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.706515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce037d-5ea7-4a12-b429-6672ad9cae1d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.751621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.752342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.752814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.753790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.770805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:50:59.774270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:50:59.775199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:50:59.776013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:50:59.778817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 122/251] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:50:59.779888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.807378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:50:59.840989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c6f27-0a87-4067-a9a5-6627cfe5d0ca None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.898692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a380a-6a95-400a-be91-e234c9789778 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:50:59.919250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.919879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.920160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.920433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.921149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:59.921463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.922861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.939079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 130/252] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:59.939420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:50:59.939916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:50:59.941099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:50:59.941678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:50:59.942200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:50:59.943299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=c95c0de1c002403fa650d70055fe35f9) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:50:59.943867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:50:59.945835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:50:59.953653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 123/253] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/role_assignments?user.id=c95c0de1c002403fa650d70055fe35f9&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:50:59.954767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.061411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:00.080141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:00.085534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2732a-de53-4fdd-9385-d4c93049f05b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.117474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520171-56ad-4d1e-a317-46989a58f112 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.133289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.135050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.135905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.136363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] PATH_INFO: `/v3/users/42db884571bf4e81853d901aa851ff98` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.138401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] RBAC: Authorizing `identity:get_user(user_id=42db884571bf4e81853d901aa851ff98)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.140129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.142977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 124/254] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/users/42db884571bf4e81853d901aa851ff98 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:00.151828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.170730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.171403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.173014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.173295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.174034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:00.174340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.176609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.197391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 131/255] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:00.204701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.345595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36583-2975-4f65-b3b5-ff6ad9ae7f21 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.357960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eb9ff-a1ad-4c9d-8fb7-86bee3ab089f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.408504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:00.414650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.415783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.416411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.416689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.418516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.419992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0bc88-e5bd-4f0b-981c-dcfdc8daef1e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.421677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 125/256] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:00 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:00.422509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.423276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.423547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.423810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.425691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3098b8-195d-413a-b22b-ff701230cd6b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.425962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3098b8-195d-413a-b22b-ff701230cd6b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.428335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3098b8-195d-413a-b22b-ff701230cd6b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.428439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.428529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.430277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 132/257] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:00 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:00.431659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.432744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 126/258] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:00.437629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3098b8-195d-413a-b22b-ff701230cd6b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.487290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:00.600278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3098b8-195d-413a-b22b-ff701230cd6b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.612916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0d247-7986-43f7-81b9-3138b39b0618 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:00.636852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.637474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.637749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.638019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.708163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:00.708859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.709145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.709425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/42db884571bf4e81853d901aa851ff98/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.711547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, user_id=42db884571bf4e81853d901aa851ff98, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.713066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbed25-27bf-4b82-9e58-d735e21571c5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.714212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:00.715717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:00.757652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:00.813937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 133/259] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:00 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/42db884571bf4e81853d901aa851ff98/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:00.816564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:00.817114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:00.817589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:00.822684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 127/260] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:00.832573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:00.845439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:00.847468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:00.973308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:01.004071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 134/261] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:01.041771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97b64-3aa3-47f6-93fd-bd2b5e33f4a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.046503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:01.074085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:01.091317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.091989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.092266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.092536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:01.094420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:01.097390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:01.099261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 128/262] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:00 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:01.105138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:01.247315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6fd7c-e9ce-462d-8506-3bf10ccfca57 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.248484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbcf90-37d3-44fd-b7a4-89f924d680e4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.291187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.291821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.292100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.292375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:01.293437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=e366c63aa681486a8e8b4d5a0de55a00) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:01.293740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:01.297368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:01.317393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 129/263] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:01 2022] GET /identity/v3/role_assignments?user.id=e366c63aa681486a8e8b4d5a0de55a00&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:01.345376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.346053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.346336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.346815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:01.367694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:01.372829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:01.373765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:01.374630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 135/264] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:01.380798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:01.462969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:01.521954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a988-2004-4e37-927b-00ed988e7db4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.572947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.573589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.573872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.574148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:01.574905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:01.575215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:01.576613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:01.590821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 130/265] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:01.597219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:01.670596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:01.738744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c6041-1628-4e7e-8793-ae218a151c67 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.788824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.789493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.789775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.790051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] PATH_INFO: `/v3/users/e366c63aa681486a8e8b4d5a0de55a00` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:01.791315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] RBAC: Authorizing `identity:get_user(user_id=e366c63aa681486a8e8b4d5a0de55a00)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:01.793108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:01.794754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 136/266] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:01 2022] GET /identity/v3/users/e366c63aa681486a8e8b4d5a0de55a00 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:01.800808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:01.914883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a175362-b9e1-432e-9af0-c794af755c67 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:01.931985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:01.957668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:01.958290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:01.958568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:01.958878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.038914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.040322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26876f-6681-4ce5-a8c8-f1653fc04bcd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.147002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 131/267] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:02.155794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.163587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c81f-8ddf-4405-87e0-887e01593d01 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.163867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c81f-8ddf-4405-87e0-887e01593d01 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.164138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c81f-8ddf-4405-87e0-887e01593d01 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.165767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 132/268] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:02.171871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.172151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.172424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.194130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:02.195393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.207463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.270826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 133/269] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:02.288030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.323734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813dd0-c407-48b0-acb0-4b8b40a91a31 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.358040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.390899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4875d-9863-4fa5-a22e-ec61d1c12e4d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.395458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608422-6575-4582-a30f-324534597f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.396127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608422-6575-4582-a30f-324534597f2c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.396412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608422-6575-4582-a30f-324534597f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.396694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608422-6575-4582-a30f-324534597f2c None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.397943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5608422-6575-4582-a30f-324534597f2c None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.399453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5608422-6575-4582-a30f-324534597f2c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.405812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 137/270] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:02.423730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608422-6575-4582-a30f-324534597f2c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.434048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.434918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.435336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.435759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.446639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d3d66aee-ed70-4e9d-a701-f945af25275b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:02.451834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:02.452723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:02.453541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:02.460360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 134/271] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:02.461846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340416e6-644a-4502-8739-1854f91fb82d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.462273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340416e6-644a-4502-8739-1854f91fb82d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.462728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340416e6-644a-4502-8739-1854f91fb82d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.464245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 135/272] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:02.465103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340416e6-644a-4502-8739-1854f91fb82d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.475169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.551189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608422-6575-4582-a30f-324534597f2c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.577838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340416e6-644a-4502-8739-1854f91fb82d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.590491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.591265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.591544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.591822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.592721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=e366c63aa681486a8e8b4d5a0de55a00) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:02.593036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.594587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacacae-ab81-4d94-bd36-c3f35d9e8be2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.601882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 138/273] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/role_assignments?user.id=e366c63aa681486a8e8b4d5a0de55a00&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=00224db748344c70b18c5c283bc0d81d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:02.603126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545632-8e3a-4e70-a517-ef3b2016babd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.603411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545632-8e3a-4e70-a517-ef3b2016babd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.603691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545632-8e3a-4e70-a517-ef3b2016babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.622603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8e545632-8e3a-4e70-a517-ef3b2016babd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:02.623861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8e545632-8e3a-4e70-a517-ef3b2016babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.636087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.636826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.637104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.637373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.638126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:02.638396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.639995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.660065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 136/274] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:02.665877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.687230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.709009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 139/275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:02.746262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2047-0701-4d31-bc4c-b60008a393d2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.746573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2047-0701-4d31-bc4c-b60008a393d2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.746893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2047-0701-4d31-bc4c-b60008a393d2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.748441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 140/276] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:02.754193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.754906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.755391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.776085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:02.777470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:02.788685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:02.841245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9e5f1-4d7e-4d93-9398-4f5b21154220 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.866916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 141/277] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:02.868791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.886569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:02.887766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:02.888244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:02.888891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] PATH_INFO: `/v3/users/7a595e4de7924ca9815a8a117074f1d7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:02.907304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] RBAC: Authorizing `identity:get_user(user_id=7a595e4de7924ca9815a8a117074f1d7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:02.909466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:02.912230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 137/278] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/users/7a595e4de7924ca9815a8a117074f1d7 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:02.914151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:02.985607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fee76-2f3d-4dee-89a4-5bc4a14b429d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:02.997154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.021284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.021917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.022198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.022468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.023628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.025080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.026671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 142/279] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:03.027441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.035009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9103a7e-f835-4d6e-94b8-b4bec1b2290c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.060190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.071681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.072319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.072595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.074459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.082870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:03.087729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:03.088633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 138/280] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:03.091542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.140730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490769ac-3eca-42d2-8812-5adde31f11eb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.178343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.179007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.179285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.186809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.186809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, user.id=7a595e4de7924ca9815a8a117074f1d7, scope.system=all) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:03.186809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.186809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.187651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 143/281] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/role_assignments?user.id=7a595e4de7924ca9815a8a117074f1d7&scope.system=all&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:03.188428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.215769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e334-ded9-42c4-8189-b17d58fb838d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.246171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.263934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.264578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.264859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.265133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.265833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.268281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f080ad-6316-4166-a8f1-f9f0351b8deb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.315382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d3e9-2d0b-4066-a4c3-456e9fa60fdd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.354942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.355492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.355770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.356044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.356764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:03.357067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.358492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.368492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 144/282] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:03.374363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.386932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 139/283] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:03 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:03.481590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e5baf-f5c1-4458-8c2f-8093763c83d1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.481880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e5baf-f5c1-4458-8c2f-8093763c83d1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.482124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e5baf-f5c1-4458-8c2f-8093763c83d1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.483559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 140/284] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:03.489072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.489365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.489637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.501430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e060c91-9ad9-4ff7-b859-4b276041cb5d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.506632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.509607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:03.510861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:03.545265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.545993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.546270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.546459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] PATH_INFO: `/v3/users/c95c0de1c002403fa650d70055fe35f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.547672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] RBAC: Authorizing `identity:get_user(user_id=c95c0de1c002403fa650d70055fe35f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.549135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.551117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 145/285] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/users/c95c0de1c002403fa650d70055fe35f9 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:03.553854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.556794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.595298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 141/286] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:03.619968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.680687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcea39-7dfe-4cf3-ba50-ce5efc9dcb43 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.728360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.729478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.729974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.730439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.731998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.733715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.735930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 146/287] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:03.742360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.751925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c18fb-3d00-471f-9b46-3615ade310ef None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.787329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.794670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.795626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.796070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.802837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.808311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:03.813678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:03.814596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:03.816048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:03.818460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 142/288] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:03.824726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:03.849586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53369f-4799-4f60-9e27-0e77205d5fd0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.860021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:03.886003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.886857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.887064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.887143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/c95c0de1c002403fa650d70055fe35f9/roles/5a5cf9961dfc49f6a5758575f7c815fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.889086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, user_id=c95c0de1c002403fa650d70055fe35f9, role_id=5a5cf9961dfc49f6a5758575f7c815fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.890535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:03.941923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21147d2-491a-4c5b-9870-ee425cf00c6a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:03.963484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 147/289] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:03 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/users/c95c0de1c002403fa650d70055fe35f9/roles/5a5cf9961dfc49f6a5758575f7c815fe => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:03.984252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:03.985385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:03.985910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:03.986344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:03.987399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:03.987900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:03.989698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:04.000326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 143/290] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:04.008117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:04.129843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:04.133123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744d18-adf7-4bb0-b45d-747006823463 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:04.171120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:04.171685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.172034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.172312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] PATH_INFO: `/v3/users/42db884571bf4e81853d901aa851ff98` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.173526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] RBAC: Authorizing `identity:get_user(user_id=42db884571bf4e81853d901aa851ff98)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:04.176322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:04.178399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 148/291] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:04 2022] GET /identity/v3/users/42db884571bf4e81853d901aa851ff98 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:04.184291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:04.295811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:04.306222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578240a1-2e0c-4732-9aed-710758afe887 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:04.352382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:04.353007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.353352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.353634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.445188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:04.446642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:04.568997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:04.582227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 144/292] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:04.588064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:04.731293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7745-5896-45d0-9921-1c5b359c9b39 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:04.769870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:04.770553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.770868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.771150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.772375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:04.773817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4cba4-15fa-4f5f-a228-3095b8688a56 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:04.775835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 149/293] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:04 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:04.781287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:04.892565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22594-3e50-4782-a791-12ee79ee3946 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:04.939553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:04.940252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:04.940606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:04.940856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:04.941647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=42db884571bf4e81853d901aa851ff98) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:04.941955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:04.943526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261271-d826-4f65-9f0f-20eeb3e02ee7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:04.952952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 145/294] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:04 2022] GET /identity/v3/role_assignments?user.id=42db884571bf4e81853d901aa851ff98&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:05.611816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f438c-2213-4919-8677-eb27c7bcb681 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:05.612950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f438c-2213-4919-8677-eb27c7bcb681 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:05.613536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f438c-2213-4919-8677-eb27c7bcb681 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:05.615305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 150/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:05.620337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:05.620826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:05.621001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:05.639876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:05.641064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:05.694312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:05.714639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 146/296] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:05.737431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f438c-2213-4919-8677-eb27c7bcb681 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:05.778480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:05.853354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f438c-2213-4919-8677-eb27c7bcb681 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:05.889599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:05.890165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:05.890443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:05.890738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:05.902397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-38ce3aa6-3478-4eb8-b1c2-49a3420e8e21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:05.908536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:05.909468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:05.910272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 151/297] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:05.915605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:05.998394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f9f0-d074-4ec1-8fdf-82bb8e4e3626 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:05.998701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f9f0-d074-4ec1-8fdf-82bb8e4e3626 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:05.998996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18f9f0-d074-4ec1-8fdf-82bb8e4e3626 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.000477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 152/298] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:06.008899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba724c-5982-4f22-b5f8-6aec663d4d02 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.009361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba724c-5982-4f22-b5f8-6aec663d4d02 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.009822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba724c-5982-4f22-b5f8-6aec663d4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.034155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f5f6-d0b7-4944-9a65-e8872a1ba6e0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.042488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-97ba724c-5982-4f22-b5f8-6aec663d4d02 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:06.045014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-97ba724c-5982-4f22-b5f8-6aec663d4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:06.090480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.091479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.091943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.092415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.093644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:06.094150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.096737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.111514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 147/299] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:06.116715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.170900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 153/300] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:06.172084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42fa0-ede9-44bb-ae5d-c86d600e7082 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.172457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42fa0-ede9-44bb-ae5d-c86d600e7082 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.172814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df42fa0-ede9-44bb-ae5d-c86d600e7082 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.174338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 154/301] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:06.179085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.179401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.179684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.179957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.199178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:06.200515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:06.226374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.240471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21596-fc5a-45d9-8907-a22e560f4253 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.285113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.285796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 155/302] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:06.286497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.290842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.291366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.291854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] PATH_INFO: `/v3/users/7a595e4de7924ca9815a8a117074f1d7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.293551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a595e4de7924ca9815a8a117074f1d7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.295730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.303605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 148/303] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/users/7a595e4de7924ca9815a8a117074f1d7 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:06.304293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.402108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe6083-841a-44fa-a95a-ab03fea98cba None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.415429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35f98b-8f11-4e2e-9435-fa20c7a0b7a0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.432937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.438446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.439111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.439395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.439668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.450414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:06.451695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.451695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.451695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.451695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] PATH_INFO: `/v3/system/users/7a595e4de7924ca9815a8a117074f1d7/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.453035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a595e4de7924ca9815a8a117074f1d7, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.454386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940fae0-3aca-46f2-8d6f-aa4e9f455628 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:06.455345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:06.456367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:06.457290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 156/304] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:06.457945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.475925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.520050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 149/305] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Aug 3 12:51:06 2022] PUT /identity/v3/system/users/7a595e4de7924ca9815a8a117074f1d7/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:51:06.521343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9cea5-f6ff-4832-beb5-5f6ccfd4094f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.521631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9cea5-f6ff-4832-beb5-5f6ccfd4094f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.521928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9cea5-f6ff-4832-beb5-5f6ccfd4094f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.523242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 150/306] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:06.525351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9cea5-f6ff-4832-beb5-5f6ccfd4094f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.568102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c00ccf-6bfe-447d-bd49-403012095a46 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.610389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.611075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.611351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.611618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.613983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.615502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629597de-b93a-4a09-aa8e-a30855e5eafb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.617351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 157/307] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:06.618501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.618815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.619076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.639407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:06.640613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:06.655298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9cea5-f6ff-4832-beb5-5f6ccfd4094f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.700116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.700651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.700932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.701218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.701923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:06.702216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.703621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.713300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 151/308] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:06.713936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.720454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 158/309] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:06.731654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.752546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.760794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:06.817637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5276b-bbd2-4301-946b-1feb0a6f82a0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.845339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b0e1-f0db-4a19-9c39-f9ce5a5bb370 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:06.854531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.855182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.855459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.855978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] PATH_INFO: `/v3/groups` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.856380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.857859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.881025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:06.881669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:06.881948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:06.882223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] PATH_INFO: `/v3/users/556fc826d0e04100830703f979907191` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:06.896033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] RBAC: Authorizing `identity:get_user(user_id=556fc826d0e04100830703f979907191)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:06.897483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:06.899150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 159/310] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/users/556fc826d0e04100830703f979907191 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:06.901419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.930250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 152/311] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Aug 3 12:51:06 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:06.931464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:06.998341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.036530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a831d-094c-4f29-85fa-c52044825d01 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.080297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.081526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.081794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.082060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.090256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec396-8673-4aac-b524-f1778ae18235 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.092703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.096159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:07.102102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:07.109940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 160/312] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:07.110828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:07.144761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.145421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.145705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.145989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.146921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, user.id=556fc826d0e04100830703f979907191, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:07.147142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.148962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.159705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 153/313] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Aug 3 12:51:06 2022] GET /identity/v3/role_assignments?user.id=556fc826d0e04100830703f979907191&scope.system=all&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:07.244684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbc253-d3e0-48a3-8a7c-6941d80ba698 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.280009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.285988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.286629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.286937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.287214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.287946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:07.288252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.289642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.299849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 161/314] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:07.306111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:07.416368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ee272-9220-4c98-a639-eee769b62d41 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.453656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.454302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.454576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.454882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] PATH_INFO: `/v3/users/c95c0de1c002403fa650d70055fe35f9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.457233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] RBAC: Authorizing `identity:get_user(user_id=c95c0de1c002403fa650d70055fe35f9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.458669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.460311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 154/315] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/users/c95c0de1c002403fa650d70055fe35f9 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:07.466091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:07.582217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c117e08-798e-4556-bbfd-0afcd21605d3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.618030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.618652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.618982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.619265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.689753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.701725 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.702822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.820762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 162/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:07.822121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:07.859456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:07.929179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46086d2c-97df-4c3c-bbc6-016c37d4d6dd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:07.964316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:07.964948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:07.965224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:07.965496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:07.966632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:07.968077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187956a-cd85-46a4-803d-1c0cd1dbf4fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:07.969728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 155/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:07.977009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:08.075708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:08.083221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a698-2a5c-4cac-9a55-bfb510d42cd2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:08.118363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:08.118932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:08.119214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:08.119485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:08.120271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, scope.project.id=41cafc57fa7c4410a1443ade01c2927b, user.id=c95c0de1c002403fa650d70055fe35f9) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:08.120577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:08.122025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa402bbb-0422-422b-9504-054c9f0c3b60 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:08.134821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 163/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:07 2022] GET /identity/v3/role_assignments?user.id=c95c0de1c002403fa650d70055fe35f9&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:08.571756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b8c-d6b6-4e70-81c5-6e82236c41f3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:08.572123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b8c-d6b6-4e70-81c5-6e82236c41f3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:08.572316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b8c-d6b6-4e70-81c5-6e82236c41f3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:08.573840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 156/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:08.578824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:08.579175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:08.579515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:08.597583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:08.598779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:08.667494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 164/320] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:08.691792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b8c-d6b6-4e70-81c5-6e82236c41f3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:08.797314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b8c-d6b6-4e70-81c5-6e82236c41f3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:08.799162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:08.833143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:08.833742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:08.834020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:08.834290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:08.844312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:08.850169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:08.851401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:08.852429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:08.858862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 157/321] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:08.860803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:08.951434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:08.963702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d23919-11dc-4b9c-a259-56b85ad9d18f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:08.999082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:08.999696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:08.999978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.000254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.000959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:09.001260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.002633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a869-d41b-4a94-8968-df6e4f07f866 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.011513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 165/322] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:09.016818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.086658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4abe-57ee-4147-9b67-2a94b5503a42 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.086901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4abe-57ee-4147-9b67-2a94b5503a42 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.087191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b4abe-57ee-4147-9b67-2a94b5503a42 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.088553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 166/323] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:09.093313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ab90-4176-473e-9ccb-9229da22cf02 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.093600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ab90-4176-473e-9ccb-9229da22cf02 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.093878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344ab90-4176-473e-9ccb-9229da22cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.112843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0344ab90-4176-473e-9ccb-9229da22cf02 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:09.114034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0344ab90-4176-473e-9ccb-9229da22cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:09.122225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd6bf4-bf81-4442-988e-733c92205b57 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.156988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.157740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.157908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.158260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] PATH_INFO: `/v3/users/7a595e4de7924ca9815a8a117074f1d7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.160037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] RBAC: Authorizing `identity:get_user(user_id=7a595e4de7924ca9815a8a117074f1d7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.161408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.163238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 158/324] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/users/7a595e4de7924ca9815a8a117074f1d7 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:09.169013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.187527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 167/325] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:09.198944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc499-471f-4e41-a821-6749931ceeee None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.199472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc499-471f-4e41-a821-6749931ceeee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.199791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc499-471f-4e41-a821-6749931ceeee None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.201978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 168/326] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:09.202494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:09.206841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.207124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.207397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.225603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:09.226984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:09.273431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5010f-2761-472a-b917-77a2816dff32 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.296017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 169/327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:09.296689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.308758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:09.312178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.312806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.313128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.313407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.314194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] RBAC: Adding query filter params (role.id=512a2d0f4ecb4913981854e03206b2e9, user.id=7a595e4de7924ca9815a8a117074f1d7, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:09.314504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.316075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.327833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 159/328] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/role_assignments?user.id=7a595e4de7924ca9815a8a117074f1d7&scope.system=all&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:09.331330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.410165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991269e4-bba2-455e-8a14-3ce64bb17b75 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.429026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:09.441696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25fb6e-3d90-4de1-97b5-bdcf66658521 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.460306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.461295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.461583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.461938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.463172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.464687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.466735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 170/329] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:09.472780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.487017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.487681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.487956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.488233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.499651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:09.505165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:09.506181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:09.507069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 160/330] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:09.513155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.564643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:09.585721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f583-6195-454d-abca-06d4a07014f0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.616030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00005c-c92c-4548-bb85-2aba6968c5dd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.619823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.620427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.620709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.620985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] PATH_INFO: `/v3/groups` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.621642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.623113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.649828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.650440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.650731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.651023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.651723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:09.652025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.653393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.662257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 161/331] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:09.668141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.679918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:09.726607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 171/332] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Aug 3 12:51:09 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:09.770932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72434f-82cb-433d-8c1c-2d32c2906e30 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.806203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.806888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.807170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.807445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] PATH_INFO: `/v3/users/556fc826d0e04100830703f979907191` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.808631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] RBAC: Authorizing `identity:get_user(user_id=556fc826d0e04100830703f979907191)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.810085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7c00d-4538-4eba-ad35-60bd7abc71bb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:09.811834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 162/333] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:09 2022] GET /identity/v3/users/556fc826d0e04100830703f979907191 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:09.818401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:09.922978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39857c52-6464-4e67-a8ce-a15e4f84f9e7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:09.957326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:09.957992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:09.958271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:09.958548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] PATH_INFO: `/v3/system/users/556fc826d0e04100830703f979907191/roles/5a5cf9961dfc49f6a5758575f7c815fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:09.960053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=556fc826d0e04100830703f979907191, role_id=5a5cf9961dfc49f6a5758575f7c815fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:09.961433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69328a-8760-4d4a-9fb6-a9d7b853b5b4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:10.024718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 172/334] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Aug 3 12:51:09 2022] PUT /identity/v3/system/users/556fc826d0e04100830703f979907191/roles/5a5cf9961dfc49f6a5758575f7c815fe => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:11.967303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d3b16-0fa7-40d0-974a-764a74b9a55e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:11.967776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d3b16-0fa7-40d0-974a-764a74b9a55e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:11.967776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d3b16-0fa7-40d0-974a-764a74b9a55e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:11.969421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 163/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:11.989340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:11.989858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:11.989858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.000514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:12.014986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:12.016186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:12.105482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 173/336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:12.153511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d3b16-0fa7-40d0-974a-764a74b9a55e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:12.250128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:12.278218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d3b16-0fa7-40d0-974a-764a74b9a55e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:12.320492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:12.321145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.321425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.321699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.338643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-39b6b2a9-20f5-488b-8c49-5648b7233cc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:12.344482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:12.345380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:12.346174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:12.353814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 164/337] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:12.361427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:12.399521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f0fe-2e58-4990-a250-7dc8ef74193f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.400034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f0fe-2e58-4990-a250-7dc8ef74193f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.400485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f0fe-2e58-4990-a250-7dc8ef74193f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.402318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 165/338] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:12.407266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.407736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.408158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.445012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:12.446444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:12.637514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f395fb-d032-4936-aa87-9c836c2e88de None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:12.657039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 166/339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:12.694565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:12.709125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:12.715185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:12.715823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.716097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.716369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.717114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:12.717387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:12.718849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:12.731607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 174/340] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:12.743760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:12.809685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:12.837297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30acd-8f0c-4b07-b4e0-615067970cfa None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:12.897880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:12.898935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.899417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.899890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.912333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:12.912798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9df5-daba-4c20-8484-3f0b77cd22b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e6158338-0a1b-4d8e-b4c0-88ffbc114c1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:12.918167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:12.919099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:12.919898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:12.923794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 167/341] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:12.925929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a79048-b0d8-46ab-aa26-e0cac70978b9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.926451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a79048-b0d8-46ab-aa26-e0cac70978b9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.926975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a79048-b0d8-46ab-aa26-e0cac70978b9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.928479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 168/342] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:12.929880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec4bdb-a1fb-4046-8439-64a044dbeaff None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.930361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec4bdb-a1fb-4046-8439-64a044dbeaff None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.930902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec4bdb-a1fb-4046-8439-64a044dbeaff None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.932789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 169/343] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:12.934030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.934519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.935014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:12.954795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:12.956642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:12.964938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:12.965502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:12.965846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:12.966184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.038327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.045278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 170/344] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:13.045715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.046803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.052744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ab0af-189b-4be7-81ee-96fa31f94e32 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.120637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.174329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 175/345] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:13.178921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.178921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.178921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.180161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd40b-4697-455c-81f8-1b5ebc19ba16 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.196884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:13.198227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:13.226952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.227882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.228583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.229059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.230484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:13.231080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.232859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.245163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 171/346] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:13.246354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.295842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 176/347] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:13.297116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.345936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.398330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289fc-0811-4ab8-8395-d74231f95ae3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.428495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.435763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbafe-a625-4f4b-91f2-8aac22ac6338 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.446407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.447251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.447842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.447984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.459522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:13.464826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:13.465967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:51:13.467040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:13.468588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 172/348] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:13.469452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.486670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.488345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.488787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.489205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.491013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.492788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.494877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 177/349] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:13.495503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.597580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cabb94-b48b-405b-b614-824651f908a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.617051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.630441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77586a71-4421-4337-b70f-0b1fbae31318 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.649238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.649875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.650150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.650429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.673789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.675329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.675813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.676261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.689910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-24c9f8de-bc78-4e74-9305-4d8a26fc5a73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:13.696863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:13.698120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:13.699166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 178/350] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:13.704573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27073d83-259c-465b-b76c-877cf2bfd77e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.704573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27073d83-259c-465b-b76c-877cf2bfd77e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.704573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27073d83-259c-465b-b76c-877cf2bfd77e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.704573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 179/351] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:13.704573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27073d83-259c-465b-b76c-877cf2bfd77e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.717836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:13.753206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.754779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.840226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27073d83-259c-465b-b76c-877cf2bfd77e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:13.884916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:13.885702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:13.886244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:13.886361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:13.887588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:13.887588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:13.889021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:13.898825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 173/352] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:13.899924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.905060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 180/353] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:13.905973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:13.936188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.011944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.034266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf362b-72cc-493d-a331-14e0b2f663c9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.054055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee820a0-f5a0-44ba-8b63-c4e7baf3b4b1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.082459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.083239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.083572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.083912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.091996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.094161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1835e5-bc39-4f43-b938-abbfcae84037 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.096442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 174/354] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.098899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.099779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.100532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.103456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.104098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.104385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.104662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.105396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:14.105697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.107113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.118494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 181/355] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.120589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.125306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:14.126377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:14.212537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.215890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 175/356] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:14.216992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.245708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c88c-b511-4dd0-840b-378a1d697a30 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.285696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.286889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.288216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.288216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.289503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.291643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.294511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 182/357] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.294511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.301672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.333379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145befc-0505-4df3-9289-08ed476a0fa2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.375255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.375906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.376182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.376456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] PATH_INFO: `/v3/users/556fc826d0e04100830703f979907191` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.377736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] RBAC: Authorizing `identity:get_user(user_id=556fc826d0e04100830703f979907191)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.380062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.382166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 176/358] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/users/556fc826d0e04100830703f979907191 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.383113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.419377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388667f2-db1e-491d-82bd-6abe367c1c7a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.460920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.462354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.462873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.463551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.464670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:14.466082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.467842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.475901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 183/359] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.476546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.493618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.502100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d27c-ccb2-4502-b324-75e5ae57b179 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.555624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.556177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.556449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.556721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.575396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.640620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6a516-1352-4a07-ba0a-295c658f95a2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.656514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.658006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.683859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.684847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.684847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.685056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.700379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6c47bba3-67dc-43e6-871e-3b5d89b479c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:14.705945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:14.707654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:14.708739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 184/360] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:14.709423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e245-fdcf-4032-be2d-590e6e3ad672 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.709423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e245-fdcf-4032-be2d-590e6e3ad672 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.709423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e245-fdcf-4032-be2d-590e6e3ad672 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.710779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 185/361] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:14.711298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e245-fdcf-4032-be2d-590e6e3ad672 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.804852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.806831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 177/362] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:14.807912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.859348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:14.861236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e245-fdcf-4032-be2d-590e6e3ad672 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.908553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.909911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.910232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.911779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.912082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.914174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:14.919210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 186/363] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:14.919210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:14.943641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0427-6ab2-4cb2-b4d5-c11ced592b75 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:14.992388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:14.993106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:14.993456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:14.993806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:14.994666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] RBAC: Adding query filter params (role.id=5a5cf9961dfc49f6a5758575f7c815fe, user.id=556fc826d0e04100830703f979907191, scope.system=all) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:14.995070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:14.996575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae77d9-6fd5-400f-9d17-573a8af46813 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.010583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 178/364] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/role_assignments?user.id=556fc826d0e04100830703f979907191&scope.system=all&role.id=5a5cf9961dfc49f6a5758575f7c815fe => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.012971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.013323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.013671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.036988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:15.038646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:15.052447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27309fb6-7b18-474e-9d51-c4689baacd3e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.096228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.098387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.098900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.099340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.100228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:15.100816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.102574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.105903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.116159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 187/365] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.121773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.128688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 179/366] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:15.130218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.178513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.273564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9407bc-1b43-47a7-937e-a2355c9e7579 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.277022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a079b7-09c6-4538-a4ec-53856c7b9a18 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.319726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.320818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.321118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.321619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.321780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.322175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.322379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.322528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.323454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:15.323833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.324427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.325406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.326243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.328923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 188/367] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.329948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.334460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 180/368] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=00224db748344c70b18c5c283bc0d81d => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.336252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.426552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.487279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eae79-e81a-4351-8258-ec860a0f0f4d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.491390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.499083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a4a64-0f25-4dc5-a93a-a5845c6b527d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.533720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.534952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.535227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.535502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.549951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.550628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.550965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.551388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.565070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:15.573471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:15.574600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:15.575558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 181/369] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:15.576360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.621300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.622970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.710163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.731866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d717-c85b-4a4a-9d71-0d403000eee6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.751563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 189/370] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:15.752456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.800102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.800754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.801032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.801307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.803123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.804616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.807809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 182/371] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.807809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.842300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:15.910797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69479a7-2d45-4816-b310-c2a9bbc31914 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.934826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88586b4-b810-4c16-896e-4e50218b79c3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:15.958698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.959883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.960350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.961219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.962121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:15.962605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.964837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.977268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 190/372] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.978353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:15.982794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:15.982794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:15.982794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:15.983068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:15.984196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:15.985946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:15.989032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 183/373] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:15.989916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.031206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.101230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.114051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fcc-e822-42ce-9c40-afef44053e91 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.114284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3228898-024b-4b75-8247-d0c1fc7eb814 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.150296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.151685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.152218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.152768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.154425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.155169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.155522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.155869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.156835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=41cafc57fa7c4410a1443ade01c2927b) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:16.157211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.159423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.165186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 191/374] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:16.166102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.230954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.232719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.316090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.329562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e8094-6124-47e7-a266-d4883974913c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.334862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.350575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 184/375] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:16.356649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.376987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.378698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.379389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.381576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.384797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.386622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.391643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 192/376] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:16.399732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.531078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001641-646e-4aab-8899-5b57b498b816 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.577259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.578274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.578553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.578941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.579732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=41cafc57fa7c4410a1443ade01c2927b) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:16.580042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.581941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.588980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 193/377] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=00224db748344c70b18c5c283bc0d81d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:16.620901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60c1c8-648c-4ff2-b7cb-ee9404a15cb7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.669809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.670497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.670811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.671091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] PATH_INFO: `/v3/projects/5cd5462246264f9f811047550f1e206f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.675544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] RBAC: Authorizing `identity:get_project(project_id=5cd5462246264f9f811047550f1e206f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.677026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbbfc1-91df-42d6-a88f-8e6b52520e89 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.679063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 185/378] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/projects/5cd5462246264f9f811047550f1e206f => generated 344 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:16.684689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.727672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.741881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c37-d41c-47cc-8753-fe18f928887b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.742692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c37-d41c-47cc-8753-fe18f928887b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.742692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47c37-d41c-47cc-8753-fe18f928887b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.744065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 186/379] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:16.749608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.750173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.750668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.789849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:16.791451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:16.884292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a8e5c-dbc8-40cd-a88a-0540c521351a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:16.890977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:16.923486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 187/380] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:16.946830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:16.955325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:16.958200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:16.959804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:16.960481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] PATH_INFO: `/v3/groups/282b227d323647269db00b97767f3183` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:16.974641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] RBAC: Authorizing `identity:get_group(group_id=282b227d323647269db00b97767f3183)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:16.976440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:16.978624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 194/381] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/groups/282b227d323647269db00b97767f3183 => generated 229 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:16.986113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:17.091927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac240a8-f1d5-4a0a-8006-eb521b83c4b5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:17.095225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:17.131783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:17.133877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.138637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.139181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.140196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] RBAC: Adding query filter params (group.id=282b227d323647269db00b97767f3183, role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=5cd5462246264f9f811047550f1e206f) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:17.140711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:17.142402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:17.158098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 195/382] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/role_assignments?group.id=282b227d323647269db00b97767f3183&scope.project.id=5cd5462246264f9f811047550f1e206f&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:17.189485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efdfe5-9904-4ba4-8370-fb192e587f80 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:17.245343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:17.246012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.246288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.246559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.272097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:17.277206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:17.278111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:17.278984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 188/383] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:17.285219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:17.410450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8449e-fced-4907-ba2e-bbf667b4f432 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:17.449015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:17.450015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.450512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.451014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.451945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:17.452447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:17.454043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:17.463325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 196/384] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:17.468649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:17.531145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:17.597047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cadb8-2a5e-4566-8267-4b2765092e49 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:17.641452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:17.642155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.642441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.642730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.647593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:17.649101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433e1e-7e74-45aa-a681-2a2d1cf52056 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:17.650899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 189/385] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:17 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:17.656974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:17.687166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:17.777360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129edac2-b386-4db8-b960-f6ec83c537f6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:17.779325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99e7a-e706-4b83-86ef-aa8b822cd1a5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.779610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99e7a-e706-4b83-86ef-aa8b822cd1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.780057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99e7a-e706-4b83-86ef-aa8b822cd1a5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.782559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 190/386] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:17.791606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.791897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.792180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.821419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:17.822631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:17.845605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:17.846291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:17.846571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:17.847018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:17.849070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:17.849647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:17.856107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 197/387] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:17 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:17.857337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:17.969230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 191/388] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:17.993222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.004611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:18.031686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817051c-8fcf-44f2-aec1-e24ee397e386 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.046167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:18.093786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.094512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.094788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.095071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.097628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:18.099174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:18.102850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36242-d80b-4e7a-92b9-9e5f49bfba14 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.140043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.141010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.141526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.141980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.153847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:18.160182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:18.161207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:18.162113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:18.164216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 192/389] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:18.170574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.257949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 198/390] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Aug 3 12:51:17 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:18.280549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d861680-b86d-4eec-b30a-911637098d31 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.290427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:18.320822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.321778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.322215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.322655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.323622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:18.324096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:18.325657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:18.340781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 193/391] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:18.342683 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.487380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5f70c-908a-41da-b53b-c67fdf93db05 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.544054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.545040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.545511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.545985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.549196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:18.550927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2d7a7-3b84-4c33-8976-f28a1df51eeb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:18.552775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 199/392] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:18 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:18.558518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.626963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34fb-4bb4-4326-813f-402f045aa2ef None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.627316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34fb-4bb4-4326-813f-402f045aa2ef None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.628092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc34fb-4bb4-4326-813f-402f045aa2ef None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.629634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 200/393] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:18.635103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.635402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.635661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.656356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:18.658034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:18.675080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:18.693272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3552d09-825a-4662-b1c1-46e000bc11cc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.731821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.732479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.732765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.733041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.734997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:18.736462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:18.738364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 194/394] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:18 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:18.744116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.751489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 201/395] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:18.780372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:18.797017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:18.907869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e74da-e22a-49b4-bae6-1ede32118907 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:18.944196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:18.944868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:18.945148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:18.945424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:18.947757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2, group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:18.949192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:18.973966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d06b-cf72-491f-ab79-84c8aa8d8f6f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.011280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.011931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.012210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.012484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.021102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.029978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 195/396] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Aug 3 12:51:18 2022] PUT /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/00224db748344c70b18c5c283bc0d81d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:19.031062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5ca3d5b5-711b-4d9c-8e70-07967b8eafa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:19.036328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:19.039377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:19.040423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 202/397] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:19.043794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.101417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b27d9-fc21-41c2-a2f8-4757b7e082cb None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.101719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b27d9-fc21-41c2-a2f8-4757b7e082cb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.101885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b27d9-fc21-41c2-a2f8-4757b7e082cb None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.103640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 203/398] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:19.113875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.114544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.115074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.137613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:19.139340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:19.227621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.231457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea34ac-868e-47c5-9710-f7333e3f59c8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.270597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 204/399] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:19.278303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.279283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.279798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.280376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.281362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:19.282345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:19.283951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:19.301184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.318359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 196/400] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:19.323507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.421016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b9d28-6847-41a1-8966-d1d070f6cbc9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.441700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6857-e8ff-458d-9dc7-9c8888cbcd14 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.455313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.457563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.458222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.458506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.458813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.470891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:19.476873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:19.477791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:19.478598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 205/401] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:19.485328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.515815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.516833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.517332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.517803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.519815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:19.522225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:19.524240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 197/402] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:19.535685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.587945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.642841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e09923-bca5-4f92-94ec-b5bd665d879e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.700709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.701360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.701882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.702359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.703460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:19.703786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:19.707114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:19.725612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 206/403] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:19.731834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.750992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394b8b-af4e-4e33-8630-9eefa5d75819 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.819831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.821114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.821466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.822533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.824981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:19.828720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:19.832604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 198/404] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:19.838885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:19.839345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.910791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ce6f4-59e6-4f30-a698-c1ee1f4515d0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.955525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:19.960770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:19.961702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.961988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.962270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.963048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace261d-9e10-4930-9434-0c37fe22cf11 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:19.963477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fb035-b1c3-4dbf-95bb-ba1df5331155 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 207/405] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0cb7-b7ad-4be2-9d2b-8cca38925a58 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0cb7-b7ad-4be2-9d2b-8cca38925a58 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0cb7-b7ad-4be2-9d2b-8cca38925a58 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:19.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 208/406] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:19.977439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d0cb7-b7ad-4be2-9d2b-8cca38925a58 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.014033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.015282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.015713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.016001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.018889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:20.021573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76673f66-5f5e-419c-aeee-f9345d44a596 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:20.092563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d0cb7-b7ad-4be2-9d2b-8cca38925a58 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.111390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 199/407] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Aug 3 12:51:19 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:20.113509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201becc-3e79-431a-af27-acf67945cefb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.114261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201becc-3e79-431a-af27-acf67945cefb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.114766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201becc-3e79-431a-af27-acf67945cefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.129176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:20.154988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.155485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1201becc-3e79-431a-af27-acf67945cefb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:20.155697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.156027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.156345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.157575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:20.157885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1201becc-3e79-431a-af27-acf67945cefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:20.159347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:20.166697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 209/408] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:19 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:20.169484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.298943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 200/409] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:20.325964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201becc-3e79-431a-af27-acf67945cefb None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.359581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c62a47-73f3-4bd3-9b11-745cb826dd17 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.411778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.412482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.412764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.413042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.417474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] RBAC: Authorizing `identity:create_grant(project_id=41cafc57fa7c4410a1443ade01c2927b, group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:20.419952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:20.442240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:20.459896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201becc-3e79-431a-af27-acf67945cefb None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.495533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.496562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.497054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.497555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.509808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:20.515422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:20.516318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:20.517154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:20.520563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 201/410] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:20.525341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 210/411] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Aug 3 12:51:20 2022] PUT /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893/roles/00224db748344c70b18c5c283bc0d81d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:20.526562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.639605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaf6fb-2a9a-4bfd-89f5-ca4e1c4fd105 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.678136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.679194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.679693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.680178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.681193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:20.681708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:20.683357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80814da-9bde-4414-8204-455e4418e5f5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:20.703127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 202/412] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:20.709073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.777041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:20.849664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa0372-ae87-46f0-833e-1f53cc26fc15 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:20.880915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48c37-2e50-4933-b404-5687b1bbe8d9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.881220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48c37-2e50-4933-b404-5687b1bbe8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.881482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e48c37-2e50-4933-b404-5687b1bbe8d9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.883127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 203/413] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:20.888441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.888730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.889084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.890816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:20.891697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:20.892192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:20.892667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] PATH_INFO: `/v3/groups/282b227d323647269db00b97767f3183` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:20.895379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] RBAC: Authorizing `identity:get_group(group_id=282b227d323647269db00b97767f3183)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:20.897045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:20.898927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 211/414] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:20 2022] GET /identity/v3/groups/282b227d323647269db00b97767f3183 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:20.907717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:20.907972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:20.916940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:20.918395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:21.053034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 204/415] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:21.062305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2e88-54e9-44bc-9eb2-7e6d8fe4d136 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.079532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.097083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.105602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.106314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.106602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.106916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] PATH_INFO: `/v3/projects/5cd5462246264f9f811047550f1e206f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.108155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] RBAC: Authorizing `identity:get_project(project_id=5cd5462246264f9f811047550f1e206f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:21.110064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:21.112960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 212/416] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:20 2022] GET /identity/v3/projects/5cd5462246264f9f811047550f1e206f => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:21.118092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.231982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ea0bf-f351-426b-88eb-415c3e48c247 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.293780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.294825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.296695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.297178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.307026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.308662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4848b-2285-47f2-8d89-623ce79a8976 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.324301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:21.329266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:21.330170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:21.331606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:21.334071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 205/417] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:21.337800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.380147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.380843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.381298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.381580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] PATH_INFO: `/v3/projects/5cd5462246264f9f811047550f1e206f/groups/282b227d323647269db00b97767f3183/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.389325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5462246264f9f811047550f1e206f, group_id=282b227d323647269db00b97767f3183, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:21.390806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c29b42-5699-4b43-9b2e-8a995d52f012 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:21.466998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec513-a97d-4394-b4c7-c719dd9bba83 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.480708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 213/418] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Aug 3 12:51:21 2022] PUT /identity/v3/projects/5cd5462246264f9f811047550f1e206f/groups/282b227d323647269db00b97767f3183/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:21.481959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4464-6d70-4765-b455-befcf15e7492 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.485835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4464-6d70-4765-b455-befcf15e7492 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.485835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4464-6d70-4765-b455-befcf15e7492 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.485835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 214/419] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:21.489939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.490255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.490452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.510650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:21.512742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:21.528308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.529708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.530460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.531087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.532783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:21.533389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:21.535771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:21.550796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 206/420] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:21.559858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.561063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.616128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 215/421] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:21.663345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.678817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.738256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb510f3-c548-4b00-98b6-05a6716f9f05 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.776877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.777497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.777772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.778041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.835811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ba668-126d-486a-80ae-5d3ecf9aa925 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:21.851949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:21.853460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:21.883546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:21.884510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:21.884510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:21.884811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:21.896096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:21.901186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:21.902089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:21.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 216/422] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:21.908350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:21.926385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:21.946048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.001688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 207/423] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:22.008377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.092741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002b02a-e5ad-4e21-8590-ec1c9d43221f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.125334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da627-a03a-430c-961f-cae1168cffb3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.165120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.165862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.166139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.166414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.168326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.169979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.171941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 208/424] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:22.175994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.176854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.177306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.178167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.187039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.187890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:22.188204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.197175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.208891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 217/425] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:22.209072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.227290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.296561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc869-c507-4ad6-80c1-b364ef93ad7d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.336914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.337560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.337810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.338091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.339677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.341510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.343447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 209/426] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:22.351654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.399399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.405273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac259e9-91a4-44dd-b936-dd53c9136b75 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.442081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.442722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.443024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.443300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.516606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.518118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.564326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.573908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677e6c-cd94-4adf-aa20-4644a4377c84 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.617098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.617715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.618001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.618260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.619080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:22.619377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.621646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb96bad-d35a-4539-9395-fea73c76a785 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.627551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.631151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 210/427] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:22.632711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4191-3c4e-4ab3-abc1-c75eb76c661e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.633011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4191-3c4e-4ab3-abc1-c75eb76c661e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.633519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf4191-3c4e-4ab3-abc1-c75eb76c661e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.634846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 211/428] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:22.640714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 218/429] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:22.645700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.645700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.645700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.647495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.668177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:22.669775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:22.833384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 212/430] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:22.859061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a6fb6-b694-4555-af80-8be72512581d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:22.874161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.903869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:22.904511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:22.904788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:22.905059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] PATH_INFO: `/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:22.906322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] RBAC: Authorizing `identity:get_project(project_id=890ed6eecd3b47ed8e1bbb12c40e43d2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:22.907855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:22.910847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 219/431] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/projects/890ed6eecd3b47ed8e1bbb12c40e43d2 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:22.916260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:22.978679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.993021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:22.994357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1d13-c668-4771-80a4-8ebdec193c1f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.029856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.030582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.030893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.031168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.032667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243655dc-3759-4a85-a547-b657641fa984 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.042364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:23.047633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:23.048564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:23.049425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 213/432] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:23.055557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.071381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.072021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.072298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.072568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.073804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.075376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.077436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 220/433] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:22 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:23.083973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.185412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1183e8-1c13-4f0f-bdca-9078bbd3c9db None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.209566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63acd37-a882-4a84-9c78-c63c49a6c3a9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.231070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.231699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.232415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.232693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.233413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:23.233716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.235117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41602a18-494d-4b76-8bf3-c6d42c1dfee9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.243128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.248424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 214/434] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:23.249256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daeb4-a595-4c99-9673-652dec3f37ca None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.249545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daeb4-a595-4c99-9673-652dec3f37ca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.249822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daeb4-a595-4c99-9673-652dec3f37ca None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.259067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 215/435] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:23.259199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.259199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.259199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.259199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.259514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48daeb4-a595-4c99-9673-652dec3f37ca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.259596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:23.259596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.259596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e285b-c821-4e30-a6f5-4d1da30d56b5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.265655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 221/436] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=890ed6eecd3b47ed8e1bbb12c40e43d2&role.id=00224db748344c70b18c5c283bc0d81d => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:23.267201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.268191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.268471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.272078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.290238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:23.291565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:23.379225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 222/437] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:23.402154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48daeb4-a595-4c99-9673-652dec3f37ca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.406474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.467772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.468984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.469852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.470315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.539363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee622b29-95d0-4364-9c3a-9b496a205912 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.566502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.568701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.572038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.577343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.578629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.579165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.579927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.581759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.595902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:23.600717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:23.601638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:23.602442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 223/438] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:23.608648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.699352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 216/439] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:23.706076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.753937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903ad0-1295-496a-a191-cea3a6f7ab3c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.798071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.798702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.799074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.799406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.800249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:23.800546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.802563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.812811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 224/440] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:23.819580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.833499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e535c-4534-4513-ae36-538a294c2025 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.848594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.871513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.872465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.872751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.873014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.874294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:23.874613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:23.875768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:23.877997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 217/441] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:23.883508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:23.928286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d501d5-d327-4c2f-9c7a-6d15db180fb9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:23.963327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:23.963869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:23.964153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:23.964431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:23.988282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80a8d-0960-4032-be8a-f099f7476bf7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.027492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.028134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.028423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.028700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.029855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.030522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.031407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51cd77-7238-48d2-920a-5b71a238d011 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.032047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830dbe-65a2-438e-be0a-7d385a71175a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.033010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 218/442] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:24.034266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080539-6c52-4f9a-9505-ff95e7759fa6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.034552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080539-6c52-4f9a-9505-ff95e7759fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.034840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080539-6c52-4f9a-9505-ff95e7759fa6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.036067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 219/443] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:24.041053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080539-6c52-4f9a-9505-ff95e7759fa6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.079681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.088768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.131043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 225/444] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:24.132364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.132654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.132932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.147509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080539-6c52-4f9a-9505-ff95e7759fa6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.151855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:24.152377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:24.181951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.182559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.186221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.186221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.186221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=512a2d0f4ecb4913981854e03206b2e9, scope.project.id=41cafc57fa7c4410a1443ade01c2927b) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:24.186221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.186221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.205218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 220/445] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=512a2d0f4ecb4913981854e03206b2e9 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:24.205218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.234847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 226/446] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:24.259798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.307924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7452b-b23a-4c79-8bd4-2541fe80efd2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.323005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.348708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.349351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.349628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.349899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] PATH_INFO: `/v3/projects/41cafc57fa7c4410a1443ade01c2927b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.351497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] RBAC: Authorizing `identity:get_project(project_id=41cafc57fa7c4410a1443ade01c2927b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.352988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.355666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.355880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 221/447] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/projects/41cafc57fa7c4410a1443ade01c2927b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:24.361536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.383822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf82ccc-69f6-48dc-bd23-531bc894430c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.431383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.432095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.432325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.432606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.444326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:24.450731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:24.451915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:24.452815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:24.455154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 227/448] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:24.461853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.495133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db4440-88f7-4cd4-9a75-39a25c2a8b3e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.539819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.540470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.540750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.541029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] PATH_INFO: `/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.542350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] RBAC: Authorizing `identity:get_group(group_id=fe9ee1ed4a7f4d4d96bfa33c9069b893)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.543965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.545581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 222/449] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/groups/fe9ee1ed4a7f4d4d96bfa33c9069b893 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:24.551463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.581430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4856-109e-4c5b-a042-0c5dd5e8f25b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.598131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.614664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.615308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.615592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.615874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.616579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:24.616883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.618274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.623294 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.627176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 228/450] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:24.633189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:24.651052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a15e-dbd9-4a30-9acf-23a9ddd858af None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.684365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.684986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.685271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.685551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.686335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] RBAC: Adding query filter params (group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893, role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=41cafc57fa7c4410a1443ade01c2927b) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:24.686646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.688110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.694641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 223/451] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/role_assignments?group.id=fe9ee1ed4a7f4d4d96bfa33c9069b893&scope.project.id=41cafc57fa7c4410a1443ade01c2927b&role.id=00224db748344c70b18c5c283bc0d81d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:24.738280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8a310-6115-4694-b612-7148b451c6a3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:24.776264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:24.776840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:24.777090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:24.777361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:24.847465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:24.850262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:24.851424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:24.951433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 229/452] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:24.957657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:25.062304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c6d05-07b2-41cf-a0fe-cb757f1e55d0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:25.072079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:25.094967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:25.095599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:25.095877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:25.096168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] PATH_INFO: `/v3/projects/5cd5462246264f9f811047550f1e206f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:25.097864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] RBAC: Authorizing `identity:get_project(project_id=5cd5462246264f9f811047550f1e206f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:25.099347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:25.101006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 224/453] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:51:24 2022] GET /identity/v3/projects/5cd5462246264f9f811047550f1e206f => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:25.106536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:25.200063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:25.202938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d31b08-cf98-4586-b6ea-15c355158168 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:25.236152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:25.236885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:25.237244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:25.237532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] PATH_INFO: `/v3/groups/282b227d323647269db00b97767f3183` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:25.238697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] RBAC: Authorizing `identity:get_group(group_id=282b227d323647269db00b97767f3183)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:25.240158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa05c-001d-4106-b71a-b14e38cddf6e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:25.241750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 230/454] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Aug 3 12:51:25 2022] GET /identity/v3/groups/282b227d323647269db00b97767f3183 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:25.247525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:25.344177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4169-d2aa-43a3-a514-d110df823985 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:25.376125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:25.376710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:25.376984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:25.377251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:25.378885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] RBAC: Adding query filter params (group.id=282b227d323647269db00b97767f3183, role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=5cd5462246264f9f811047550f1e206f) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:25.379192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:25.380617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8f055-d6c6-4712-a720-b23a6767cf81 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:25.386132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 225/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Aug 3 12:51:25 2022] GET /identity/v3/role_assignments?group.id=282b227d323647269db00b97767f3183&scope.project.id=5cd5462246264f9f811047550f1e206f&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:27.736361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc560db3-66c9-42e9-a6b2-40d36bd5d6b8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.737223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc560db3-66c9-42e9-a6b2-40d36bd5d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.737634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc560db3-66c9-42e9-a6b2-40d36bd5d6b8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.739421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 231/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:27.744932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054b1e-9f69-4340-8678-52c3ad718ad0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.745672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054b1e-9f69-4340-8678-52c3ad718ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.746086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054b1e-9f69-4340-8678-52c3ad718ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.769900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-63054b1e-9f69-4340-8678-52c3ad718ad0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.771368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-63054b1e-9f69-4340-8678-52c3ad718ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.823767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:27.865901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 226/457] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:27.904982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc560db3-66c9-42e9-a6b2-40d36bd5d6b8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:27.931547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53c25-60e3-46be-921e-ad0c1f49a16f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.931831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53c25-60e3-46be-921e-ad0c1f49a16f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.932112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c53c25-60e3-46be-921e-ad0c1f49a16f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.933487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 227/458] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:27.939128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a823-a34a-4585-a808-5a73d8cfcd13 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.939415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a823-a34a-4585-a808-5a73d8cfcd13 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.939694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5a823-a34a-4585-a808-5a73d8cfcd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.963317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-abf5a823-a34a-4585-a808-5a73d8cfcd13 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.964444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-abf5a823-a34a-4585-a808-5a73d8cfcd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.047469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc560db3-66c9-42e9-a6b2-40d36bd5d6b8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.054775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 228/459] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:28.054775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f15f5-9ec9-4293-b120-2413bf48cbb3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.054775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f15f5-9ec9-4293-b120-2413bf48cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.054775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f15f5-9ec9-4293-b120-2413bf48cbb3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.054775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 229/460] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:28.060519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.060808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.061085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.089040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.090583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.100921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.101830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.102301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.102900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.114606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.116485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:28.134181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:28.135130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:28.136209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:28.136209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:28.136209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.136209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:28.137724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 232/461] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:28.138691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.171622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.172804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 230/462] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:28.173868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.216264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.265729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9526-8970-4443-9f1a-9b87c64bc032 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.293518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a554889-1111-41d6-9c0c-38acaeed7e03 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.303078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.303854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.304195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.304551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.316939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.318623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.335198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:28.335755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:28.336789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:28.337888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:28.337888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:28.337888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.337888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:28.338649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.343315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 233/463] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:28.343315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.343996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.344434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.345308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.345763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.347950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.362103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 231/464] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.363825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.419315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.452498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5397-e5be-4312-85f7-f9351f4fde8c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.467627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.477473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165dacd-dfe9-47e4-8310-ccaaed8bbaf7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.491733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.492574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.492999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.493414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.504868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.506541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.515332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.515960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.516243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.516522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.517331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.517641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.519099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:28.524241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:28.525289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:28.526317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:28.526317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:28.526317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:28.526317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:28.532553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 234/466] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:28.533648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.537662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 232/466] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.538563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.639072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243f8be-a936-4c95-8c23-a44ac70c65e3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.645494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ddd0-0386-4baa-bc25-8619fd1f790e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.663924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.677026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.678010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.678362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.678726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.679760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.681901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.688076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.688913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.689338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.689755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.690596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.691112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.692746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.708577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 233/467] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.711103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.727514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.801001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 235/468] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.801954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.824586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c428-d1f7-4587-a25a-cd4a001a59ae None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.876515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.877464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.877921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.878744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.879639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.882384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ac57b-605f-45f5-b4de-9e61bd9244bf None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.920816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33cb25-3cd1-4cdd-a0f1-ba9d461bd949 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.959794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.960503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.960784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.961056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.961750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.963274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.974907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 234/469] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.976769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceea96c-9b28-495a-971a-afe9b6584f67 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.977076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceea96c-9b28-495a-971a-afe9b6584f67 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.977350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceea96c-9b28-495a-971a-afe9b6584f67 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.978925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 235/470] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:28.986660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4f8f-16a4-4078-b96f-d3182a47cd6c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.986975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4f8f-16a4-4078-b96f-d3182a47cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.987372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4f8f-16a4-4078-b96f-d3182a47cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.017375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b7fa4f8f-16a4-4078-b96f-d3182a47cd6c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.018683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b7fa4f8f-16a4-4078-b96f-d3182a47cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.063142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 236/471] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:29.106481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.115691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 236/472] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:29.142579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.188680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.263724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da420-2310-4d08-9893-9ab8668896b6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.302843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.303499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.303784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.304062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.309442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e6b6-16fc-4422-b7da-96d3c95c961e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.309730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e6b6-16fc-4422-b7da-96d3c95c961e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.310010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e6b6-16fc-4422-b7da-96d3c95c961e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.311586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 237/473] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:29.317948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.318125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.318652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.319216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.319531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:29.337475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:29.338404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:29.339336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:29.339336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:29.339336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:29.339336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:29.339336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 237/474] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:29.343236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.344745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.344861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.424134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 238/475] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:29.443761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.453834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.456492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6844-b824-42a5-aeff-f07fb948a2ec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.494947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.495688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.495972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.496251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.496955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:29.497262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.498747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.518856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 238/476] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:29.524656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.573622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfda6a-4847-425e-9e6a-cb74cd71ce87 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.603761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.613693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.614607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.615179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.615695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.619907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.619907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.632512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe91f3-0ee1-48bb-8102-8b134bd5378a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.664340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:51:29.664340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:51:29.664340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [parameters: {'id': '72fe9004e0694d44b6c214564fb7d227', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:51:29.664340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:51:29.683031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.683675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.684419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.684704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.685473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.691743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:51:29.700607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return ref.to_dict() Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:51:29.701516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:51:29.702477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:51:29.703461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:51:29.704350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:51:29.705180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'id': '72fe9004e0694d44b6c214564fb7d227', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:29.705985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:51:29.709027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.718460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 239/477] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:29.718460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.807862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 239/478] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/users => generated 249 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:29.839909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a27a-a21e-4802-acc5-40f463374ef1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.879597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.880232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.880539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.880790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.892213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-e0774d5c-0555-4e3c-ba6d-7a2db9c7e299 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:29.898007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:29.899007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:29.899813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 240/479] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:29.906826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.917259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:30.054617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65163f-2e1f-481a-90c4-adee33b3ff05 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.091287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.091830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.092109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.092434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.093149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:30.093502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.094930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ba37d-b185-461a-89bc-6ff39d865c50 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.104122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 240/480] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:31.583527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9dcc-ed2e-4ee4-a088-9a6cd935ce7f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.584046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9dcc-ed2e-4ee4-a088-9a6cd935ce7f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.584476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9dcc-ed2e-4ee4-a088-9a6cd935ce7f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.586522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 241/481] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:31.592283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.592729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.592911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.618776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233605-d5e2-4f68-8dbc-f57c9fe94fc7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.618776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233605-d5e2-4f68-8dbc-f57c9fe94fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.618776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75233605-d5e2-4f68-8dbc-f57c9fe94fc7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.620938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 242/482] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:31.622984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:31.624232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:31.626747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.627259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.627734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.671719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:31.673317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:31.712955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:31.725989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 241/483] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:31.747353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:31.758982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.803155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 243/484] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:31.827098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.936927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73ce21-c964-4859-8968-159ef0f35e9f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.980914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.981570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.982271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.982271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.997781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-af77c9f4-0203-497e-aa70-4f4014fc8da2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:32.002848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:32.004447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 242/485] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:32.012354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae977-1c1d-4e37-a66f-e6b3a0967ffe None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.013109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae977-1c1d-4e37-a66f-e6b3a0967ffe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.013109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae977-1c1d-4e37-a66f-e6b3a0967ffe None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.013109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 243/486] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:32.013109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae977-1c1d-4e37-a66f-e6b3a0967ffe None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.018518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb564a-15d2-4a01-8aea-14f1076f6521 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.072172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.073164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.073636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.074258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.080473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.087995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-65278dd5-0455-4ec4-85af-7ad2ed4a33f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:32.094389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:32.097223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:32.099563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 244/487] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:32.101911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.102431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.103919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.131637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:32.133373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:32.135031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae977-1c1d-4e37-a66f-e6b3a0967ffe None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.176699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.177491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.179389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.179389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.179389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:32.179644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.180908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.182950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.193986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 244/488] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:32.195271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.239048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 245/489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:32.240260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.310204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b196ad-30d7-4298-8f83-7552f0b79217 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.330352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.351468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.353418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.353906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.354399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.355437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:32.356054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.357678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.367827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 245/490] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:32.368958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.398456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c6707-5f6d-487f-abf9-e6690f78c6ef None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.444728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.445682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.446184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.446619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.464130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.466095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:32.489696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:32.490610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:32.491820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:32.491820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:32.491820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:32.491820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:32.495703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 246/491] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:32.496585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.525325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.578167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad84ac0-09bd-4600-a830-849efbcd5295 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.613916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175de8f-a198-4974-8fd1-be3218e0d84d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.616540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.617188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.617474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.617751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.628312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:32.634059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:32.635023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:32.635827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 246/492] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:32.636580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.651011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.651657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.651935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.652207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.663730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.665407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d1482d47-36ee-45e1-ac1b-ee2545d0ba0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:32.681403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:32.682286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:32.683181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:32.683181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:32.683181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:32.683181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:32.683404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.687764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 247/493] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:32.689033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097cd16-aa87-4b8a-b511-86f34bd1c82f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.689382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097cd16-aa87-4b8a-b511-86f34bd1c82f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.689599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097cd16-aa87-4b8a-b511-86f34bd1c82f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.698026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 248/494] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:32.698026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097cd16-aa87-4b8a-b511-86f34bd1c82f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.758922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c59ee-302e-4390-99e7-3d23c19d6f8e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.777078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.799820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.800963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.801341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.801609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.802360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:32.802597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.802913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097cd16-aa87-4b8a-b511-86f34bd1c82f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.804005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.821509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 247/495] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:32.821509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.844622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.845321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.845684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.846013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.846828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:32.847221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.849374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d843-4da6-4a9b-a7f7-cf7471f955ec None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.857645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 249/496] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:32.858681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.858993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.859269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.877484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:32.878898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:32.931534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.934976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a418d0-b666-4198-9fdc-ada4ef67260f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.945596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 250/497] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:32.946983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.982750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.983299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.983577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.983858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.984546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:32.984849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.986236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.998859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 248/498] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:32.999674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.020875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.054848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab31fc2-42a6-4d6f-bc93-455d96b0d2ae None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.087595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.088225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.088502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.088774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.095771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.096132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3b8f7-8d40-433d-bca6-1a420ce6de47 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.097210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6241a245-f467-431e-9654-a5ca38449029 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:33.110763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.111862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 251/499] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac034a8-0e2e-41b5-86bc-31f18f2a48d3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.118116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac034a8-0e2e-41b5-86bc-31f18f2a48d3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.118968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac034a8-0e2e-41b5-86bc-31f18f2a48d3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.118968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 252/500] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:33.118968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac034a8-0e2e-41b5-86bc-31f18f2a48d3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.133496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.134134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.134414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.134689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.144839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.146293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:33.161178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.165419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 249/501] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.166262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.179946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.221314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac034a8-0e2e-41b5-86bc-31f18f2a48d3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.247292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.254527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.255190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.255467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.255746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.261103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71764ac3-e897-4ccc-a3cd-046eab37953a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.266617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:33.272199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.277013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 253/502] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.277900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.302844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.303478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.303757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.304029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.311076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.312529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b481ece2-888d-41f9-8344-f3e80b6cf622 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:33.325007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.325954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:33.326912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 250/503] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.327728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.328004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.328301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.346036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:33.347241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:33.377141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683f21-23e8-4d20-a473-6db9af1f279d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.409623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.411172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.411507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.411798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.412587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:33.412890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.412973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 251/504] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:33.413714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.414342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.416044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.460932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 254/505] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:33.461872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.510431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.515615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef71d-30dc-4e1d-87d0-07e7a25543c5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.550366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.551038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.551656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.551656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.552257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:33.552559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.553950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.563101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1b9d-9828-46a6-b3dd-dfe2b42bcc9e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.565298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 252/506] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:33.566136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.599340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.599955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.600232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.600504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.601208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:33.601512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.602899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.610530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 255/507] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:33.611334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.631015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.669820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5b83-6e5f-455e-a6c8-74976df520a1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.705943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.706568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.707685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.707967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.708750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:33.709056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.710483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.715372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c18cc-058e-4979-87b3-07515e24eedb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.724023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.746023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 253/508] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:33.746884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.748275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.748923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.749205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.749484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.760653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.762038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:33.776612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.777536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.778401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:33.778401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:33.778401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:33.778401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:33.778401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 256/509] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.778674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.852054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44edde-39be-487b-9aec-66d209d3488d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.871480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:33.875944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daacce-1042-40c0-83ab-41ce698a8d45 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.885126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.885739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.886016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.886285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.910448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.911116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.911396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.911669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.920568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.922016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:33.933271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:33.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:33.935141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 257/510] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:33.935720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.955960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.958073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.961062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.036461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48d02-09bd-4613-8745-cd089d56cc2a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.055680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 254/511] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:34.056596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.071280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.071919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.072201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.072481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.077231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.082955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.084432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:34.099000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:34.100033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:34.100886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:34.100886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:34.100886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.100886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:34.100886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 258/512] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:34.101320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.159993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea31f36-02b2-4671-8dda-c00c1e1d144c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.169475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.194103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.194734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.195040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.195313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.198392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136707f-7ded-4bc3-ad46-bc0aede10a82 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.231051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.231659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.231941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.232216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.232899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:34.233208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.234611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.246995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 259/513] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:34.247861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.261939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.263434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.283457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.346655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8871c-c9a1-4eaf-82af-9b846717253d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.361450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 255/514] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:34.362277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.378308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.383776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.384450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.390196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.390196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.390196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:34.390196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.390196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.404112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 260/515] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:34.404920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.465041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66d7d-eef2-446d-987c-67854ea88ed4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.485323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.499317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.499947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.500225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.500499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.504557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db88adf-508d-489d-8501-a87a5a163adf None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.510368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.511832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:34.527260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:34.528139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:34.529020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:34.529020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:34.529020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.529020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:34.529020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 256/516] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:34.529302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.542415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.543312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.543592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.543865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.544549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:34.544854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.546208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.558086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 261/517] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:34.558980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.608549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.627964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30295317-19a1-46d4-be5d-5e3a25eb5443 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.658154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ff8-4269-4da2-9823-6ca77641d757 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.661019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.661641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.661924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.662200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.662904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.664367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.691440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.692074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.692351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.692623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.702794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.704225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:34.717976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:34.724384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 262/518] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:34.725518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.771049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 257/519] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:34 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:34.771884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.806576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.830282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f392-6ad8-4695-bc81-3bf8a52321a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.832755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.868637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.869584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.870096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.870484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.887986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c246a6-fd44-4adc-86d4-40abe3e749a4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.929173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.929801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.930758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.930758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.931108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:34.931410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.932798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.947209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 258/520] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:34.948676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.954396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.955887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.040634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.053859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce583ad-0b68-4494-a3b2-7cc26d96921a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.070496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 263/521] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:35.070496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.071056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.097113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.098326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.098731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.099022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.106602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.108093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:35.120119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:35.121205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 259/522] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:35.122278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.178337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95848-228c-45b8-ad0c-2b6be59fd505 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.214319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.214962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.215246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.215524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.216217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:35.216519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.217877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.229304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 264/523] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:35.229304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.237493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be304ba0-75bb-4de3-aeef-d80671e3e965 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.275976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.276733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.277014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.277290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.284590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.286540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.294246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:35.300096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:35.301135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:35.302080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 260/524] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:35.303133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.313468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.340114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb1bfa-1627-4ca6-9c23-61fcdecbcb22 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.376615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.377936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.378225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.379040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.391381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.392845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:35.407402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:35.408468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:35.409641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:35.409641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:35.409641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:35.409641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:35.412293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9177-51ad-45e5-ad8c-d86179bdb5ec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.413169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 265/525] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:35.414011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.449019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.449885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.450315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.450796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.451738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:35.452191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.453797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.472813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 261/526] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:35.473868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.527625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe594cc-bdce-4e24-96da-3c8b31d82155 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.541943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.545461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.564643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.565282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.565628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.565907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.573476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.575109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.583255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46315a-e26c-4189-9ea6-057254d38864 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:35.587746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:35.588758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:35.589829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:35.596067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 266/527] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:35.596067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.623204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.623982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.624435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.624770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.625609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:35.625981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.627682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.652276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 262/528] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:35.652276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.701377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f87bf-64da-4974-8ec0-6fa6fba6df0f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.735677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.736318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.736554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.736830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.737513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:35.737816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.739881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.756885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 267/529] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:35.756885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.769967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd929e4-9f62-4117-b307-0dbac20c00a6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.789666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.795695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.805066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.805689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.805965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.806237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.861163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031021-e37b-4421-98b4-4338629a12ac None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.878371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.879972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.897538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.898474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.899039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.899544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.900505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:35.900964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.902680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.923166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 268/530] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:35.923946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.993407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 263/531] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:35.994571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.022702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.027333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.033967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138294b-ad2d-4dda-885c-e1d02cd83292 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.067729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.068448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.068726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.069001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.069848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:36.070161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.071690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.077376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 269/532] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:36.078228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.118296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1fd9b-9602-46f7-b70a-fbfbecb1edf8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.171475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.172953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.173842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.174313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.185849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.188344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.198504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3b02a-4f9b-437a-8b08-79e78f562598 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:36.205810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:36.206935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:36.208051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:36.208477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 264/533] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:36.215143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.253053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.254530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.255047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.255540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.257537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=6485a82c946346f9b0a53a87056116ae) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:36.258109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.259797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.267625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 270/534] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/role_assignments?user.id=6485a82c946346f9b0a53a87056116ae&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:36.270056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.307193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.313682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.346950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e53e6-a8d6-466d-a67e-c53ce4156bd7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.420418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.421079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.421360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.421692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.439305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.440817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.458766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc8d7-167c-4d1b-bfb5-13ad46d232da None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:36.474739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:36.475660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:36.476550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:36.476550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:36.476550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:36.476550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:36.476550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 265/535] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:36.483840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.511168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.511792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.512068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.512338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.513218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:36.513529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.515555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.538751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 271/536] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:36.540974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.659058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ca01-e092-4fd9-8e66-f28cb94d2c37 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.697830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.717689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.718316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.718597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.718899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.719598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:36.719901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.721278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.732851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08088d56-3613-4bed-9fef-86c4d69c8e55 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.736653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.748641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 266/537] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:36.754692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.790983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.791657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.791875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.792149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.793200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=e31fc272e5f24eac95630f0fced91df6) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:36.793611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.795254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f4ee3-8212-4ba3-9a37-e9017fc070a3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.802191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 272/538] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/role_assignments?user.id=e31fc272e5f24eac95630f0fced91df6&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:36.885409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb796-9343-46d1-90c6-fd73420a81d2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.905784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ccfd-4c0a-49f5-920a-b3a7776eeab9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.906149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ccfd-4c0a-49f5-920a-b3a7776eeab9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.906340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55ccfd-4c0a-49f5-920a-b3a7776eeab9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.908091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 273/539] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:36.913781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.914069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.914338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.923500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.924138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.924413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.924684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.932394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.933887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.941952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:36.943392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:36.947145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:36.948073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:36.948963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:36.953164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 267/540] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:36.954563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.037271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:37.065290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0330e-bc47-4af7-b3e0-bedbbc5e4c7e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.103003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 274/541] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:37.117848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.118480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.118783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.119060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.119813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:37.120118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.121636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.125017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.146269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 268/542] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:37.150020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.279139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:37.288045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da176-b844-4d73-a84e-6bf7907b926e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.307365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:37.325506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.326124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.326405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.326680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.327500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=3c1c76b285a347fe8fea56f5eda4da12) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:37.327810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.329320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.335795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 269/543] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/role_assignments?user.id=3c1c76b285a347fe8fea56f5eda4da12&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:37.339204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952517b-e4c1-48ca-9157-f130fb24768e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.414278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.414953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.415228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.415496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.435152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:37.440030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:37.441148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:37.442547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:37.446222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 275/544] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:37.447335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.582350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49690a5-10f2-4722-b8d2-f90795d3da45 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.625764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.626448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.626744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.627025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.627788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:37.628095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.630086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.639175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 270/545] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:37.645590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.818086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042e63b-5020-44ec-afcb-7ade9c1885fd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.868400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.868968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.869240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.869505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.872328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:37.884690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.886151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:37.902801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:37.903701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:37.904550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:37.904550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:37.904550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:37.904550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:37.904550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 276/546] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:37.909510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.989359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.046195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723b2a2-a8b5-4fc7-af39-2df6c3b5654c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.090099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.090732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.091022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.091291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.091979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:38.092278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.093641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.110557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 271/547] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:38.116419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.244669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d33c89-3e34-42e3-ba53-ef4acb7bf794 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.295569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.296223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.296502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.297016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.307822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.309271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:38.324285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:38.325441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:38.326363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 277/548] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:38.331098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.472746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c808bc-a327-4d5e-b842-858e95f87454 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.475205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.515357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.515891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.516169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.516437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.517226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:38.517528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.519230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b250-bb34-4d33-92cd-06fc32744da9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.542413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 272/549] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:51:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:38.547801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.596428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0553-74af-4906-8eff-65cf1b40cf4a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.596731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0553-74af-4906-8eff-65cf1b40cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.596972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0553-74af-4906-8eff-65cf1b40cf4a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.598859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 273/550] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:38.604233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b5db-316e-4f45-805c-030afb098149 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.604514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b5db-316e-4f45-805c-030afb098149 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.604790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b5db-316e-4f45-805c-030afb098149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.627169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.639923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9886b5db-316e-4f45-805c-030afb098149 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:38.641132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9886b5db-316e-4f45-805c-030afb098149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:38.688621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315e6e9-1d33-4922-9910-7a8b106bc7de None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.725919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.726552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.726865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.727142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.791064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 274/551] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:38.813876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886b5db-316e-4f45-805c-030afb098149 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.849358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.851554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14092b93-2528-4136-818c-65a2a836f2c5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.928727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.945035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.954749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886b5db-316e-4f45-805c-030afb098149 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.995059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.996067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.996638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.997115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.000198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 278/552] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:39.001924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a5376-8f69-4064-8d0e-b3b1ac7b4a17 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.002223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a5376-8f69-4064-8d0e-b3b1ac7b4a17 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.002505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a5376-8f69-4064-8d0e-b3b1ac7b4a17 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.003881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 279/553] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:39.004762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a5376-8f69-4064-8d0e-b3b1ac7b4a17 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.015792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9bd9f61f-c9c7-439b-b2b2-f47a13b4a506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:39.022674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:39.023643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:39.024469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:39.027722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 275/554] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:39.029181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.029658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.030165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.057488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:39.058811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:39.145430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a5376-8f69-4064-8d0e-b3b1ac7b4a17 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.158865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 276/555] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:39.160444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.205928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.206577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.206981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.207288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.218058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.221039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.230302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:39.237614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:39.239839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:39.240779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:39.240779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:39.240779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:39.240779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:39.244209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 280/556] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:39.245191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.275538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.299631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8c9b-e459-4ea9-830a-8a1cee30fe72 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.344112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.345131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.345738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.346216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.347178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:39.348328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.349908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.359561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 277/557] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:39.360313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c253a-6c06-4fe0-b9ae-d3b8bbe6d3ac None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.360777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.395943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.396585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.396910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.397191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.407264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5fdac2eb-d677-4654-b336-e17ef0644fb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:39.413416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:39.414835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:39.415697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 281/558] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:39.416765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e512b-30d8-4bb3-9dc6-22e8826039b7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.416765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e512b-30d8-4bb3-9dc6-22e8826039b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.416765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e512b-30d8-4bb3-9dc6-22e8826039b7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.421853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 282/559] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:39.422627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e512b-30d8-4bb3-9dc6-22e8826039b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.478776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f622680-48df-400e-9315-23d37c3f3b86 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.487869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.516978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.518669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.518669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.518669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.520477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:39.521155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.523073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.529324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e512b-30d8-4bb3-9dc6-22e8826039b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.537900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 278/560] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:39.538759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.544024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.571578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.572229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.572518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.572792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.584525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.585981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cc4c6869-840a-4270-a618-83967f176dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:39.600911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:39.601999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:39.602940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:39.602940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:39.602940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:39.602940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:39.602940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 283/561] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:39.603647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.603877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.604155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.621937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:39.623187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:39.651561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462c89f-ca98-4700-845c-c7e8a2cd9e25 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.692258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.692705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.692993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.693270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.693994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:39.694302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.695728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.699377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 284/562] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:39.700496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.719350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 279/563] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:39.720992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.745910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.794750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.801397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462386de-dc9c-4412-a0b7-f982d0e693ae None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.830106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0241-632c-40ef-b71d-3ddbcaaf8067 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.836264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.836901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.837179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.837451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.844195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.845689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:39.858451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:39.859884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 285/564] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:39.860788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.869683 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.870334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.870625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.870956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.871634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:39.871937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.873316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.886346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 280/565] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:39.887163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.960738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74f93-b451-4138-abd4-b33af06ce3f2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.962207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:39.985554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da53305-8c28-42ea-935c-fca225f6a008 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.995007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.995640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.995914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.996181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.006952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.008381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.011903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.019988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.020618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.020902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.021180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1c8b25fd-3c79-43cd-9667-8a3ade471b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:40.022973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.023949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.025024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:40.025024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:40.025024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.025024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:40.025024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 286/566] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.025548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc469-8872-4aaa-817a-547696f475e6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.025830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc469-8872-4aaa-817a-547696f475e6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.026102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc469-8872-4aaa-817a-547696f475e6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.027355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 287/567] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:40.028029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fc469-8872-4aaa-817a-547696f475e6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.036205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:40.041093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.042169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:40.043507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 281/568] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.047587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.130309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fc469-8872-4aaa-817a-547696f475e6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.145669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7250a-6c50-453a-9c6f-2f7cd44aef84 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.164386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.165005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.165286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.165562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.166315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:40.166620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.168342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.180580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.180939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 288/569] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:40.181215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.181499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.181740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.181841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.189380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.190961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.198502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7fa01c76-1021-4f2f-af24-631867c62cbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:40.203317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.204428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:40.205390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 282/570] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.206072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.206072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.206196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.223744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:40.224941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:40.266447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.283104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916d976-ddab-4a1b-b421-9e99cca81a0e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.290509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 283/571] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:40.291449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.318204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049918a-955d-4d92-93b9-40937978643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.318858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049918a-955d-4d92-93b9-40937978643e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.319147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049918a-955d-4d92-93b9-40937978643e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.319418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049918a-955d-4d92-93b9-40937978643e None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.320106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049918a-955d-4d92-93b9-40937978643e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:40.320412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049918a-955d-4d92-93b9-40937978643e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.321767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049918a-955d-4d92-93b9-40937978643e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.333043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 289/572] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:40.333836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049918a-955d-4d92-93b9-40937978643e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.397870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baa864-c2a8-4b89-9d98-257025f4e0ab None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.407766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.432892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049918a-955d-4d92-93b9-40937978643e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.433786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.434464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.434768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.435076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.435780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:40.436080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.437449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.445595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 284/573] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:40.446478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.466906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.467510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.467784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.468051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.468824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=57923b067b6e441ea8d516d830cdf7de) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:40.469125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.470542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.476391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 290/574] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/role_assignments?user.id=57923b067b6e441ea8d516d830cdf7de&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:40.477159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.488848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.556439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe51b-b52c-46d5-b70b-a441b44ff6ea None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.590850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7207517-44f7-4ff2-b9f9-efa83b97718f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.592691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.593392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.593743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.594090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.595007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:40.595380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.596896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.620666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 285/575] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:40.621777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.636195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.636970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.637343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.637709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.645525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.649926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:40.655266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.661269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 291/576] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.662488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.737157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.744487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f63-946c-490e-b500-da324bd9533e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.780286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0bc0-9cfc-44a2-8f73-3b46b4577cbd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.780490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.781084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.781364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.781637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.790143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.791646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:40.803336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.804522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 286/577] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.805523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.828984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.829627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.830051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.830448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.849008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.850468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:40.864898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.866529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 292/578] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.867589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.920400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb4b03-b4f1-4c56-9237-07686fcc8d7a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.922790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.956348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.957580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.957855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.958160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.968986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.970429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.976918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da991-2bc4-406f-8864-1a577cae8fa1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:40.985980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:40.987411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 287/579] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:40.988353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:40.999385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.018244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.018911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.019840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.020125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.020835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.021137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.022619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.030559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 293/580] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.031464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.105485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca476-9131-499b-a03d-efcea90057e8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.137470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d84d-9129-4b35-b30e-cbb16c486069 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.145960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.148741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.148741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.148741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.148741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.148741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.149767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.153553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.168465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 288/581] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.169684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.180083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.180636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.180916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.181185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.181873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.182173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.183560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.200926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 294/582] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.200926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.247143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.283452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ce9b8-a9e3-49e5-899d-9a6ab984f05c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.307345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcea-6011-48fa-b9bc-24b5e032c44f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.320062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.321045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.321424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.321704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.322513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.322846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.324218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.341638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 289/583] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.341638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.347118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.348404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.348688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.348957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.358802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.360237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:41.375767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:41.376662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:41.377572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:41.377572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:41.377572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:41.377572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:41.377572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 295/584] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:41.377849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.406474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.461624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31a50-5d05-4861-b4fc-f0d80debbd4b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.484031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7a577-7afa-4897-b5e9-874a9f02b822 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.489845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.500044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.500756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.500966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.501242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.512538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.513997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.520403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.521045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.521328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.521604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:41.529050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:41.529987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:41.531565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:41.531565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:41.531565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:41.531565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:41.531796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.531869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 290/585] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:41.531869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.535660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:41.547625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:41.548601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 296/586] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:41.550252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.639757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.656249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d62d5-3461-4c43-98f6-650320add756 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.659786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2af4-6b48-4f30-aeb3-9fc04fc88fe5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.695372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.696252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.696536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.696812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.697504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.697816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.699218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.701972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.702635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.702986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.703305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.711459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.713035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.716221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 297/587] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.716939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:41.724876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:41.725825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:41.726761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 291/588] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:41.727265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.767915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.831367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc35bb-8566-49a8-9d98-00c3c6467e18 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.834500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced663c-95c6-4a41-887e-17a60d79938a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.868682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.869392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.869663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.869836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.870309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.870504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.870829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.870993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.871250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.871522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.872213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.872323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:41.872615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.874045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.884453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 298/589] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.889335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.892698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 292/590] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:41.892698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.898860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.999809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.005243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ef83-1b20-4435-af13-a8e4cbec6fc3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.006748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274fd60-940d-4b99-ae59-f0ed262d3a3a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.042071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.042281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.042988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.043094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.043263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.043382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.043531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.043623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.044275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:42.044575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.046012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.052348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.053778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.059060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 293/591] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:42.064588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:42.065158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:42.066110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 299/592] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:42.068196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.136639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.179014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e349586-f050-4b10-bfb7-dedf6e684302 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.179676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92890f-df8e-416b-8e83-eb77bf2d6f14 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.216170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.216559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.216812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.217097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.217194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.217375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.217472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.217719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.225286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.226766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.230061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.231558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:42.239531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:42.240432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:42.241354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 294/593] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:42.241842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:42.252349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:42.253294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:42.254280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:42.254280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:42.254280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:42.254280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:42.254280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 300/594] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:42.255410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.263362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.354494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2bfc8-2147-47d9-867d-651104d7b533 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.365341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e132-20a4-4efc-9fee-9c2074e273ab None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.382229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.390738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.392620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.392620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.392620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.400355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.400975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.401257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.401531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.402336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:42.402641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.404204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.410445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=1035c2a2b6b8440a9d975751de4724da, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.412386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.422989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 301/595] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:42.423819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.497555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 295/596] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:42 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:42.498534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.534446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5fc89-6e92-4b48-8eb3-83bb47e827d6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.575150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.575780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.576058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.576333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.577088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:42.577392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.577561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.578923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.597117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 302/597] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:42.597117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.625690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87eb47-6a08-419d-9428-1d0df9bbf586 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.632625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.670146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.670884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.671171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.671476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.672171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:42.672477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.673860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f770b-9938-42ee-a467-6338590c5a62 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 296/598] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7c38-7615-47be-9b58-f4caddcc15a1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7c38-7615-47be-9b58-f4caddcc15a1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7c38-7615-47be-9b58-f4caddcc15a1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 297/599] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:42.700993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7c38-7615-47be-9b58-f4caddcc15a1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.725469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c326-7983-4bf0-a2c1-aa6be6182702 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.772428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.773312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.773600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.773872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.787031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.788411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:42.803964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:42.804919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:42.805830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:42.805830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:42.805830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:42.805830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:42.805830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 303/600] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:42.806140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.816877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7c38-7615-47be-9b58-f4caddcc15a1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.844087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.852484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.855558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.855558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.855558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/6485a82c946346f9b0a53a87056116ae/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.869494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=6485a82c946346f9b0a53a87056116ae, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.871152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed61d8-2918-48f0-9a22-6338f799a137 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.899753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:42.914303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0dfaf-c92a-48fe-bdbf-87df4b3a3d11 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.938354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 298/601] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:42 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/6485a82c946346f9b0a53a87056116ae/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:42.939534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.939827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.940100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.968985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.969841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:42.970302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.970881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.971173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:42.971578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.983040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.985677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:43.005294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:43.006290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:43.007242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:43.013417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 304/602] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:43.013417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.067412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 299/603] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:43.068213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.138223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2fc77-3976-4438-bd08-3c2847c888e3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.173776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.174865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.175929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.176574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.177643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:43.178279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.179794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.193950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 305/604] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:43.194740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.197087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652e65-8e4d-4eec-892b-79ce6ef209ea None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.206462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.208376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.237401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.238896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.239304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.239946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.241007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:43.241808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.244029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.258973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 300/605] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:43.260136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.315474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785999d5-a166-408b-8beb-cb20b88cecf0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.352418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.353368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.353906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.354428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.367522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:43.372773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:43.373726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:43.374579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:43.377426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 306/606] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:43.378593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.390680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b9fcd-cc9f-4e6c-8211-d747530d4e6a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.435029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.435841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.436621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.437020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.446065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.448289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.450218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:43.463089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:43.464137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:43.465270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:43.470869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 301/607] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:43.473712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.494336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33473-f73b-4808-a613-03a7958b873a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.511882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.532071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.532741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.533016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.533306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/e31fc272e5f24eac95630f0fced91df6/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.560952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=e31fc272e5f24eac95630f0fced91df6, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.562443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.612509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e6079-a110-4326-9017-b2e91deea060 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.650008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 307/608] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:43 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/e31fc272e5f24eac95630f0fced91df6/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:43.650349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.650935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.651046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.651610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.651805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.652500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:43.652801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.654423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.666569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 302/609] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:43.672391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.795958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.808819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff232ef-fdc5-4f8a-8b4e-8189a88cac65 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.809247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644602e-dbed-4799-8ff7-0788cdc22d48 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.835227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.861150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.861783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.862059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.862331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.864752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:43.865015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.866568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.882264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 308/610] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:43.887802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.903031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.903703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.903985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.904639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.921847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.923596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:43.944079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:43.945221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:43.946351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:43.946351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:43.946351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:43.946351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:43.946351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 303/611] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:43.952134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.037946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1526f8-4b8d-4d2c-879c-3889f1463fe3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.092399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a63c62-267d-407f-b075-98c8383bcb12 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.109998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.110923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.111305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.111685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/3c1c76b285a347fe8fea56f5eda4da12/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.148514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=3c1c76b285a347fe8fea56f5eda4da12, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.148514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.161154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.161930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.162316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.162694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.163570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:44.164038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.165570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.179424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 304/612] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:44.179743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.184990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.263310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 309/613] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:43 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/3c1c76b285a347fe8fea56f5eda4da12/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:44.310627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0227a-6bf3-42ea-a995-9eef377b88cf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.371476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.372348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.372779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.373157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.388108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.389788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:44.412575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:44.413597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:44.414577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 305/614] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:44.420900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.452139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.542312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19818b-507d-4a62-9109-0924dc1e0d30 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.581632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.582925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.583207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.583478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.584272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:44.584573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.585995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff5c0-2657-4b4a-994b-237ee0ce250e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.610327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 310/615] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:44.616297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.670564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ed74-8676-4ff2-93bf-2cdbc67e2f4e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.670890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ed74-8676-4ff2-93bf-2cdbc67e2f4e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.671078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ed74-8676-4ff2-93bf-2cdbc67e2f4e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.672666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 311/616] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:44.678252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.678651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.678962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.699635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.707942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:44.709477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:44.761691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f37d5-a843-4f20-beab-157a18cc0a8c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.799288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.800315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.800896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.801406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.822035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.825052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:44.851740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:44.852719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:44.853646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:44.853646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:44.853646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:44.853646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:44.861487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 312/617] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:44.863508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 306/618] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:44.869082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.885752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.893802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.017365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51c828-8f00-4f90-a20b-a7d74c81b70d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.032488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.053445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.054093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.054376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.055705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.065693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:45.068961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df62a-61e0-4180-8f3c-58a47b6dbd98 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:45.071267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:45.072223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:45.073097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 307/619] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:45.084272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.164785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.165440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.165724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.165997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.166699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:45.167037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.168677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.189407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6c63-1643-4c27-b498-5558a7b1f5ce None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.194879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 313/620] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:45.195876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.252291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.252922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.253203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.254133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.254793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:45.255100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.256501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.270790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 308/621] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:45.276307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.322140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.351068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.368586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a8f7f-0626-4968-bf5c-40af3a284e1d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.432031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.432676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.433060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.433339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.440911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.443060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.445018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d2b-7d0b-4b5d-a2f6-49e352720bbf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d6ce8902-282a-4c13-b5b3-695b52bd0ec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:45.455693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:45.456642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:45.457849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 314/622] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:45.458783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb4ba-e440-4d3e-a1c4-a03411830bd3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.463433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb4ba-e440-4d3e-a1c4-a03411830bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.463731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafb4ba-e440-4d3e-a1c4-a03411830bd3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.465430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 315/623] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:45.466152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafb4ba-e440-4d3e-a1c4-a03411830bd3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.495541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.496427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.497130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.497411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.512619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.514588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4dcd90ac-9761-4329-9f53-ef63b45338b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:45.535091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:45.536900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:45.538119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:45.538119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:45.538119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:45.538119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:45.540502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 309/624] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:45.546730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.546730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.546730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.564308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:45.565498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.599023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafb4ba-e440-4d3e-a1c4-a03411830bd3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.637810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.638429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.638762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.639132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.639887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:45.640250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.641748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.643700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.661439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 316/625] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:45.661919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 310/626] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:45.662416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.663163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.695101 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.786756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c591-0079-43da-bb01-ec19a02789e0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.810201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19196a-3b3f-4ecd-aa6a-219e1a476db7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.824371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.825143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.825427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.825702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/57923b067b6e441ea8d516d830cdf7de/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.841702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=57923b067b6e441ea8d516d830cdf7de, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.843381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.848876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.849606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.849985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.850375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.851213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:45.851617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.853092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.869710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 317/627] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:45.869710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.921656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 311/628] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:51:45 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/57923b067b6e441ea8d516d830cdf7de/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:45.922428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.931825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.004220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244dff7-ca7f-424b-8e92-840810bff442 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.014128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.072053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.072704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.072912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.073187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.086962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98137d3f-1039-49e3-b982-9227137975c8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.101762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:46.109700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:46.110839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:46.111693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 318/629] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:46.119503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.169502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.169967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.170308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.170583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.182313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.184011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:46.199315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:46.200760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:46.201727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 312/630] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:51:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:46.206338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.264197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe7bb-a76b-47a0-8491-bf4673a2e30a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.280207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.301366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.302352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.302919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.303397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.304329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:46.304841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.306424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5c9b-86ed-473a-9f6b-de5dd5c9eeca None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.320582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 319/631] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:46.322425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49452ef-3d07-4067-bf41-ed752c755076 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.322770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49452ef-3d07-4067-bf41-ed752c755076 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.323149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49452ef-3d07-4067-bf41-ed752c755076 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.324815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 320/632] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:46.325601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49452ef-3d07-4067-bf41-ed752c755076 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.341455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336e57-d12c-46e7-877c-a77952d48f7f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.376674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.387753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.388491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.388858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.393585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.393585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:46.393585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.393585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755d07e-e3bb-4d71-acb2-56339f81a10c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.413602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 313/633] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:46.415110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.415496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.415869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.434858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:46.436270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:46.462908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49452ef-3d07-4067-bf41-ed752c755076 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.506778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.507422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.507696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.507967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.520123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.521812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:46.538771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:46.540433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 321/634] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:46.541845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.548470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 314/635] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:46.551576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.591209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.673475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c397a2-715e-4d59-8d2e-983fc87d570c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.675253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d88f-6737-4d43-851c-40f48acb2157 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.689453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.712546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.713405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.713688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.714005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.714285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.714703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:46.714928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.715039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.715196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.715467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.716619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.735019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 315/636] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:46.735715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.787168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.788613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533f45-a944-4918-8ac8-8a434aecfafa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.817151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.842236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1270-4115-43c7-8c0a-1b12ef815fdf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.876823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.877467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.877744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.878017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.888983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:46.894801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:46.895891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:46.896747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:46.898421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 322/637] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:46.899616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ce9a4-c8d7-40bd-abb8-fa06a66b6f9a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.899906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ce9a4-c8d7-40bd-abb8-fa06a66b6f9a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.900181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ce9a4-c8d7-40bd-abb8-fa06a66b6f9a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.900755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 316/638] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:46.901406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.902841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 323/639] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:46.903570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ce9a4-c8d7-40bd-abb8-fa06a66b6f9a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.941272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.014930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ce9a4-c8d7-40bd-abb8-fa06a66b6f9a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.016276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809223e3-089b-4894-b7aa-807a2e4d181b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.048734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.054582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.055249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.055525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.055794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.057406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.058153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.058554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.058884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.063635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.065061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.069443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.082196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:47.082935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:47.083877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 317/640] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:47.084872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0e04ec4a-f313-4f09-aa20-37b1dc58c56c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:47.086590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:47.088643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:47.090895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:47.090895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:47.090895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:47.090895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:47.092607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 324/641] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:47.093830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.094117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.094393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.113400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:47.114586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.184430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.185786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 325/642] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:47.186500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.212284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f9aa-d726-47ac-b2e8-089291837541 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.248363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.249020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.249262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.249533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.250327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.250630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.252155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.267137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 318/643] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:47.267137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.299320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15f6d-42f8-4a2e-b277-bc7bfa7b1604 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.310370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.336678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.337328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.337615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.337888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.338680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.339042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.340447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.358109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 326/644] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:47.359076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.374984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455029af-1d73-43e7-be4d-0045a5bbacd3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.411383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.411998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.412275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.412570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.413336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.413638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.415042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.427070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 319/645] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:47.427857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.449620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.465728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76933d71-0594-478e-8ae0-a468da091f88 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.500655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.501360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.501641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.501916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.512894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:47.517786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:47.518763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 327/646] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:47.519981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.544362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0935e3-97ee-4615-8344-193c70a8cd2b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.548730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.589513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.590688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.591170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.591768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.604287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.605734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:47.622112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:47.623075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:47.623995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:47.623995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:47.623995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:47.623995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:47.624232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9702-1bb8-4ac5-b8ef-1a3616320e94 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.627866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 320/647] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:47.629490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.659447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.660259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.660540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.660809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.708661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.734898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.738250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.743984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ec19f-5874-442a-82e9-ce939e93e931 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.765372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.778601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.779299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.779607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.779881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.786888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.788409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:47.799909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:47.801500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 321/648] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:47.802449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.851667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 328/649] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:47.851667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.917271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7f97-ae9b-46ea-9afb-99eb4a4417bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.944362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.953530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.954447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.959043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.959043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.959043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.959043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.959398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482196cb-4170-4eec-a994-71f12d1fbdbd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.959492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.974333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 322/650] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:47.974333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.983565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.992279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.992898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.993174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.993443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.995302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.995302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.995882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.007875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 329/651] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.008681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.090399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1063684-4c7d-4c62-9b4f-8b077c2572bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.114723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5d9f-9c22-4f54-8c86-91d8765822b6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.130129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.130774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.131058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.131327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.132069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.132376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.133807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.145754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 323/652] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.146561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.154627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.155468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.155904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.156318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.177758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.179508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:48.193786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:48.194802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 330/653] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:48.195763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.205198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.238614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.254930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c30bd1-60c3-4b2a-974d-16a160d21958 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.289788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.290421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.290702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.291003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.295786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a52fd4-c811-4501-aa7e-1110065bff92 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.301820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.303310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:48.317282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:48.318380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 324/654] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:48.324131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.336627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.337402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.337687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.337958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.345310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.346765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3ad3ad32-29a2-4c89-b738-28f41faa7107 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:48.358293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:48.359261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:48.360202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 331/655] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:48.360826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773d67-4626-4812-a121-e3e792e4efc7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.360826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773d67-4626-4812-a121-e3e792e4efc7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.361128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773d67-4626-4812-a121-e3e792e4efc7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.366784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 332/656] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:48.366784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7773d67-4626-4812-a121-e3e792e4efc7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.425884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74f7be-91ac-42f4-ae23-26da6d755196 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.428206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.460336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.461483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.462120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.462401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.462675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.463491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.463800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.463894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7773d67-4626-4812-a121-e3e792e4efc7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.465247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.471047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 325/657] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.471828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.501765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.502398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.502672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.502975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.504288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.504730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.506187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.523290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 333/658] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.523290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.592498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b0d76-47ad-42f2-b74e-2a732b9f9be4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.633387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.635260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.635260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.635260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.635868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.636177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.638074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d378874-f3e7-4bb4-97bf-fca037f82131 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.640262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88852-6884-4fb8-9956-a4ba4e111e49 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.653654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 326/659] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.655050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.655336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.655616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.677444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:48.678752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.683674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.684904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.685339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.685760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.687200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.687662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.689270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.705978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.714768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 334/660] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.715685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.735557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.758375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 327/661] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:48.759280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.822987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6f564-aa2f-4609-a572-d9c8698b08df None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.858864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.859690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.860069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.860448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.869097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.870570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.884099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfae6e-dc6e-4e00-9044-0e59c157548c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:48.885434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:48.886800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:48.888126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 335/662] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:48.888690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.928927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.929383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.929664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.929938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.937623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.938876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:48.951353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:48.952391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 328/663] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:48.953439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.974099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.981677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.002994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb09d6-c1f8-4a9c-8d2a-5b418d06269c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.037640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.038259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.038532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.038832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.064730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fca757-a23f-4b61-8c51-a5e855356e69 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.100949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.101593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.101875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.102161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.110449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.111954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.113814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:49.119321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:49.120431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:49.121466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:49.128211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 329/664] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:49.129847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.194161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.213291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.221805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 336/665] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:49.221805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.242362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d88c7-16b7-41da-9c16-4550f25088bc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.278117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.278854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.279138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.279416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.280172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:49.280484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.281926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.294770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 330/666] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:49.295587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.327831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3173a52-7467-441b-be3c-ea11bd43aa1c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.364901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.365520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.365802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.366076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.366923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:49.367776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.369335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.387756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 337/667] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:49.388390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.408936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14714-2092-4b5b-96eb-3177819d01f9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.425304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.445089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.445632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.445916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.446194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.446933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:49.447240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.448622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.450854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.457718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 331/668] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:49.458587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.498784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49cbe2-1780-4d77-a61c-d10a9188e33f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.533470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.534111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.534389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.535212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.545505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.546961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:49.563175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:49.564112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:49.565019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:49.565019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:49.565019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:49.565019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:49.565019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 338/669] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:49.565783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.568105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2b691-7964-43ee-858f-946bf43e8658 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.605632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.606249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.606526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.606832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.607613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=6485a82c946346f9b0a53a87056116ae) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:49.607910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.609354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.626912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 332/670] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/role_assignments?user.id=6485a82c946346f9b0a53a87056116ae&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:49.626912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.684086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.710438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50454e-315e-4677-8c64-69bcd4509ce2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.715098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.757259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.758166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.758450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.758820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.763045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9d1ad-2295-4d33-a51b-3f2aed6c8d9a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.814691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.815660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.815660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.815955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.829340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.830928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.846943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.849863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:49.849987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:49.850865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:49.851782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:49.851782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:49.851782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:49.851782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:49.851782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 333/671] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:49.852726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.969020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.981217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120a33d-cc90-4ff3-93f4-6257072a071d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.984837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 339/672] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:49.986617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.001040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.027808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.028442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.028722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.028993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.029682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.029981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.031602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.047648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 334/673] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.053219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.106274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390fef8-092e-4e7a-a1b2-1c9830b90c17 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.142942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.143562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.143844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.144910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.145604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.145905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.147382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.163583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d3d8-4a44-44f3-98a6-9dc0cd4da784 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.164163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 340/674] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.165040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.202447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.203493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.203983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.204482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.216635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.218468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:50.234680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:50.235652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:50.236586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:50.236586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:50.236586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:50.236586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:50.243090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.243578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 335/675] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:50.244469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.274927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.276518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7908c85-0a39-4229-8507-18d77ec01ae4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.311906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82882679-570a-4390-a195-495830b5b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.312835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82882679-570a-4390-a195-495830b5b0ef None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.313285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82882679-570a-4390-a195-495830b5b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.313702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82882679-570a-4390-a195-495830b5b0ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.321772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82882679-570a-4390-a195-495830b5b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.323466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82882679-570a-4390-a195-495830b5b0ef None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-82882679-570a-4390-a195-495830b5b0ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:50.337673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:50.338619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:50.339557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:50.342099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 341/676] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:50.343188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82882679-570a-4390-a195-495830b5b0ef None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.358781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d8f4-b5c6-4802-8acd-a7366d17a1ee None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.395291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.396068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.396418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.396795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.404374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.405921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:50.419241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:50.420237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:50.421203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:50.425267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 336/677] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:50.426435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.464008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82882679-570a-4390-a195-495830b5b0ef None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.473865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.502516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.504520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.505326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.505798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.507036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.508096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.509037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.522272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 342/678] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.527960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.528225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.541020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6dee6-ee85-4e58-8235-b6ef4e4ae301 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.579299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.579920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.580207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.580485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.581239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.581622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.583284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.595569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 337/679] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.596525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.636925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a600-1097-4d5c-b6ce-56b7d043534a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.673974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.674591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.674900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.675175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.676503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.676806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.678229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414157d9-27bb-4c83-900b-80e217b7c2fa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.699836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 343/680] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.701146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4292-d01c-474a-ab55-30ecf0750905 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.701434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4292-d01c-474a-ab55-30ecf0750905 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.701711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e4292-d01c-474a-ab55-30ecf0750905 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.707071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 344/681] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:50.707977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4292-d01c-474a-ab55-30ecf0750905 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.717315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909bf7-5237-48a9-a6f0-c770ca590985 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.735936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.758833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.758833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.758833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.758833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.765127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.766571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:50.778440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:50.779823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 338/682] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:50.780943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.790421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.822379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e4292-d01c-474a-ab55-30ecf0750905 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.860352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.861079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.861425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.861761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.862615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=e31fc272e5f24eac95630f0fced91df6) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.863559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.865049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0706-2758-4d8e-acfd-909ff5fb1fe1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.871901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 345/683] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/role_assignments?user.id=e31fc272e5f24eac95630f0fced91df6&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.872518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.872703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.873082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.889956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1910a27-7509-4005-b43e-1a4588e54d85 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.898948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.901343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.934580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a934-0741-46da-969a-82e80728953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.935561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a934-0741-46da-969a-82e80728953f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.935894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a934-0741-46da-969a-82e80728953f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.936170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4a934-0741-46da-969a-82e80728953f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.002400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 346/684] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:51.004075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.015688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a934-0741-46da-969a-82e80728953f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.017234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4a934-0741-46da-969a-82e80728953f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.027951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.033954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.145095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b3a71-1b6b-40b2-b127-c476c8114d1c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.158630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 339/685] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:51.160396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a934-0741-46da-969a-82e80728953f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.281571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4a934-0741-46da-969a-82e80728953f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.293601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.304185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.313658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.320822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 347/686] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:51.321810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.328825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.329588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.329944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.330904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.348781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:51.356567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:51.357548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:51.358439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 340/687] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:51.359609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.428975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.457304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd31dea-cd42-4398-973e-2ba2198291a9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.478923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2249e77-ee9a-43b0-a1d1-ddae105444bd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.510898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.512084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.512823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.513280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.518425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.519672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.520182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.520523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.521401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=3c1c76b285a347fe8fea56f5eda4da12) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:51.521781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.523415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.528261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.529981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.530297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 341/688] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/role_assignments?user.id=3c1c76b285a347fe8fea56f5eda4da12&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:51.531380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:51.554925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:51.555937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:51.556845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:51.556845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:51.556845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:51.556845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:51.559823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 348/689] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:51.566841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.583077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.751374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce7e0-a710-4fe1-a394-bbf40198d176 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.762839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19b96-386f-4ad7-b5f5-4675b40aeb31 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.788213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.794446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.795207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.795491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.795767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.796570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:51.796877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.798332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.805350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.806257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.806842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.807326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.808319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:51.808795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.810348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.814814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 349/690] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:51.817375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.826413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 342/691] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:51.832939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.940673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58363803-0bcd-4a5a-aeef-ad0e5f8a450f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.950390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.958234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955217-0ccd-43f5-8b72-72cb22c6a013 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.986792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.988443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.989398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.989978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.994256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.994999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.995281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.995556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.998383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.000348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.007836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.009373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-07172986-a1da-4866-ac1a-4bb121c3cbbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:52.014692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:52.015796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:52.016881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:52.020247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 350/692] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:52.021997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35685e8-2623-4efa-ab1a-23b0229a8c45 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.022490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35685e8-2623-4efa-ab1a-23b0229a8c45 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.022969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35685e8-2623-4efa-ab1a-23b0229a8c45 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:52.028651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:52.029610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 343/694] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:52.030532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.031571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 351/693] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:52.032424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.032720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.033000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.061040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:52.062466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:52.128825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.139927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a542bc-f73f-4216-83a3-bd4c501af060 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.149427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 352/695] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:52.150338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.187889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.188310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.188762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.188869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.189648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:52.189958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.191656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.205285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 344/696] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:52.206164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.210577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.294280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6ee49-ceaa-4955-bd27-78e54f5d1dec None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.321537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682ed6f-0939-422c-a7f9-1f969039bacd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.342151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.344063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.344558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.345321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.346477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:52.348001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.350131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.358937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.359567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.359840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.360122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.366030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 353/697] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:52.367102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.372879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.373801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:52.390507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:52.391464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:52.392382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:52.392382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:52.392382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:52.392382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:52.392382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 345/698] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:52.392664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.424653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.460632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.501485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68b8c-166a-4f8a-ae7b-3c06fca8fa7d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.514905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fee319-d04e-460c-a204-631fc335c77e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.539167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.539804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.540129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.540405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.541229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=57923b067b6e441ea8d516d830cdf7de) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:52.541538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.543410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.550215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 354/699] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/role_assignments?user.id=57923b067b6e441ea8d516d830cdf7de&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:52.551244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.559588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.560629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.561758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.562256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.574463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.576840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:52.595194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:52.596236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:52.597273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:52.600578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 346/700] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:52.610215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.729849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1456f-c1c8-40e5-a70d-7dc7781d4bc3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.738915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.780319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.781528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.781974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.782540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.783608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:52.784078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.787120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.807771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 355/701] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:52.812898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aa51a-13e2-4577-a729-a0436b958840 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.813056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.844684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.854361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.855138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.855427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.855701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.856615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:52.861131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.861131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.878367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 347/702] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:52.883539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.921598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701afc9f-c614-4ee4-948c-d97663b734fd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.958427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.959191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.959546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.959929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.960713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.962263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae7be1-d15f-4297-aea3-2f53acd7d141 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.998441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302bbd-de0f-4d0d-9789-a94413d87000 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.040072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.040709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.040993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.041268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.043537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 356/703] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:51:52 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:53.100015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.129301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.130897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.142833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25aad-7033-4aaa-9d2f-c1feb2150754 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.143183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25aad-7033-4aaa-9d2f-c1feb2150754 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.143387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25aad-7033-4aaa-9d2f-c1feb2150754 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.146830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 357/704] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:53.152702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.152977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.154467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.176767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:53.178293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.199806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.270869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 358/705] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:53.291880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 348/706] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:51:53.294951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.299722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.395258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.427359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ec9c-a8cc-4b53-a809-fa462a24d712 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.450199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa757-fd15-4a27-b287-6b1e657ddc45 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.470025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.471070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.471553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.472022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.483823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.485614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.492801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.493450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.493727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.494001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.494635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.496740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:53.504388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:53.505324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:53.506297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:53.506297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:53.506297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:53.506297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:53.508603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 349/707] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:53.508727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:53.509631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:53.510532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:53.515144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 359/708] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:53.516301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.518841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.544344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.663979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44337b2-d0ea-474f-802d-0c1fba383119 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.694747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.704694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399fcf-5208-4268-8e2e-2c2b794ac05c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.709129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.710041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.710542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.711036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.711951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:53.713568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.715193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.734902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 350/709] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:53.752127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.780299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.782074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.782562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.783065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.784044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:53.784604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.786925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.800550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 360/710] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:53.807968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.907480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55a4f-2551-431f-9a9a-cb74f9b41a97 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.950281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.952121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.952978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.953523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.955373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:53.957697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.959588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47b60f-1265-4e9d-ae01-77be5206c9c6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.981831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 351/711] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:53.989989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.003887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68667-d163-41b3-97a5-9bcfd6ecc0c5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.004630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68667-d163-41b3-97a5-9bcfd6ecc0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.005352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68667-d163-41b3-97a5-9bcfd6ecc0c5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.007448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 352/712] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:54.021146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.021723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.022169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.041958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028177b-5ec9-469a-9158-96390d8a8b69 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.060632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:54.062193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.122394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.123088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.123368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.125209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.142052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.144595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:54.160363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:54.161331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:54.162324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:54.169462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 361/713] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:54.171056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.187065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.190243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 353/714] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:54.215417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.290250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dee0-4b1f-480a-b744-28f06042fbe9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.331026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.331720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.332170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.332451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.333232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:54.333541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.335047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.338107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.354733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 362/715] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:54.356192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.496249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee1d59-323f-436a-9a19-42ef4bc46f57 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.512848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599f534-1a08-49c5-9924-8dd0aeabf6ae None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.556032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.557748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.558836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.559460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.561358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:54.562048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.564406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.573761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.574689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.575220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.575684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.576501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.578525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 363/716] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:54.580120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:54.599004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:54.600088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:51:54.600935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:54.604055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 354/717] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/services/network => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:54.609844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.717700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.777744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751030e5-05a9-4f0d-b5f0-52cd8fe6ce62 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.817676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.818299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.818572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.818871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.819544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:54.819840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.821239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413a43d-b38c-41db-a210-81bc1f9762b0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.826124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 364/718] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:54.831309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.895362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.970512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20472704-4324-4d54-a4db-60f40a7eb8d4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.015520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.016144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.016420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.016692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.017372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] RBAC: Adding query filter params (type=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:55.017675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.019776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92c805-657e-4a76-9dc1-5ce0913d55bd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.029304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 355/719] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:55.443889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872d36-7f2d-4147-b7f8-19652b7e4526 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.444593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872d36-7f2d-4147-b7f8-19652b7e4526 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.445072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1872d36-7f2d-4147-b7f8-19652b7e4526 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.446910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 365/720] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:55.452619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1b13-03c1-4a8b-8d5e-0b6696e58251 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.453144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1b13-03c1-4a8b-8d5e-0b6696e58251 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.453622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1b13-03c1-4a8b-8d5e-0b6696e58251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.479886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d7ed1b13-03c1-4a8b-8d5e-0b6696e58251 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:55.481451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d7ed1b13-03c1-4a8b-8d5e-0b6696e58251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.560009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 356/721] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:55.583538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872d36-7f2d-4147-b7f8-19652b7e4526 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.683795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c5952-4713-4cbf-9b8e-d1e49a6a4ae0 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.686090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c5952-4713-4cbf-9b8e-d1e49a6a4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.686090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c5952-4713-4cbf-9b8e-d1e49a6a4ae0 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.686090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 357/722] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:55.691639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.692363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.692363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.716613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:55.718087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.755623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1872d36-7f2d-4147-b7f8-19652b7e4526 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.764911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:55.785344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:55.797763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 358/723] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:51:55.811381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.812026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.812345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.812618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.823522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.829970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:55.835258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:55.836232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:55.837138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:55.842956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 366/724] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:55.843826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.938095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0de087-859c-4267-9317-7e738bd5a25d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.975435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.976447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.976913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.977388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.988729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:55.993905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:55.994894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:51:55.995820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:55.998572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 359/725] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:51:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:56.002976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae575-9076-4f19-85e5-1f23e469fa67 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.004928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.043972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.054891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.055893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.063960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.063960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.063960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:56.063960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.063960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.081293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 367/726] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:56.088127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.150408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcad10-ff61-4cd6-8ff6-173640ff1a8b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.190420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.192047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.192541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.192997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.194459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:56.194995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.196574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.206304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 360/727] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:56.212902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.213586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.287143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef167fc-534c-469e-87a6-7f41f035e999 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.353467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.361342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ccce-9201-4522-8422-6836d44ea975 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.387433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.388090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.388365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.388673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.400090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.401008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.401470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.401936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.418801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.420640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.425136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.427081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:56.444579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:56.445543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:56.446455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:56.446455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:56.446455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:56.446455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:56.448107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:56.449014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:56.450011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:56.450011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:56.450011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:56.450011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:56.450011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 368/728] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:56.451308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 361/729] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:51:56.457676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.458841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.585646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93d5e8-25a0-4454-b040-23c981a3c011 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.587447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.603174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e5054-314c-47d2-9dd6-a6cb1eab5824 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.624782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.625417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.625692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.625963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.626672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:56.627058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.630329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ab22-6336-41f4-87c6-4dfb06d9322a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.652259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 369/730] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:56.652259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66bfd-c4c0-4e1a-8f5d-c62b025907ae None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.652259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66bfd-c4c0-4e1a-8f5d-c62b025907ae None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.652259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66bfd-c4c0-4e1a-8f5d-c62b025907ae None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.652259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 370/731] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:56.653708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a66bfd-c4c0-4e1a-8f5d-c62b025907ae None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.656509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.658764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.659267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.659989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.661012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:56.661525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.663154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcc136-8b77-47a8-894c-b9b88445b9d9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.681843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 362/732] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:56.683610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.684120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.684612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.701670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.708342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:56.709568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.781591 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 363/733] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:56.782535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.789592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a66bfd-c4c0-4e1a-8f5d-c62b025907ae None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.829054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.830139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.830745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.831226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.839721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.841497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:56.855224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:56.856192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:51:56.857155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:56.859771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 371/734] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:56.865866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.886860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.889887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0406-87f4-41c6-8319-ca68b562bb75 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.928958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.929601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.929887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.930348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.933077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.938103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.939559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:56.952275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:56.953438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:51:56.954410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:56.958406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 364/735] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:56.959531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.984538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9348e-c4f7-4608-9a92-17e30924f32a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.023363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.024335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.024903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.025486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.026434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.028206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.067810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509759d3-6752-47d3-9b52-39e958fd2aaa None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.103467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.104006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.104285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.104579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.104818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 372/736] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:51:56 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:57.105517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:57.105686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.105850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.110999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dd96-ccaa-47bf-b6cf-1497864b5cb3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.136183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 365/737] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:57.138582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3480-3bb8-4152-b59d-decda45911b7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.144157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3480-3bb8-4152-b59d-decda45911b7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.144157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3480-3bb8-4152-b59d-decda45911b7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.144157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 366/738] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:57.144157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3480-3bb8-4152-b59d-decda45911b7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.278873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.295316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.323712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed50-5cb5-4a24-82bf-f88f47ef81e6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.355535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3480-3bb8-4152-b59d-decda45911b7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.365705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.366663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.367201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.367671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.368676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:57.369267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.370912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd299b2-33cd-489c-8bcf-8dd74b3f88f0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.390664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 373/739] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:57.392688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.393174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.393816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.397867 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.398484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.398780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.399060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.414971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:57.416523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.478150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.479517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.488997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 374/740] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:57.499811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.541984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.590613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 367/741] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:57.591999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.595074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.619812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b76e7-e9aa-4c1a-bc11-8246cb9e6d1d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.658126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.658770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.659053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.659328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.696223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3798ea-02e3-4c51-80c4-4278a093143b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.733807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.734443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.734748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.735029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.738930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.740385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faefeb7-e313-4205-939e-c427a7ae86fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.745316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:51:57.750181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:57.751238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:57.752148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 368/742] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:57.752853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.773196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.809338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.849896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 375/743] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:51:57.851502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd91a-4983-4050-b4e3-badfbdd63a39 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.851788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd91a-4983-4050-b4e3-badfbdd63a39 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.852065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bd91a-4983-4050-b4e3-badfbdd63a39 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.853465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 376/744] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:57.857983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bd91a-4983-4050-b4e3-badfbdd63a39 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.867432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b285-1f2f-4e28-ac42-ad4ae58d13bc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.903628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.904193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.904456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.904727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.915632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.917796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:57.933754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:57.934667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:57.935646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:57.935646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:57.935646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:57.935646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:57.935646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 369/745] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:57.935951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.968447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bd91a-4983-4050-b4e3-badfbdd63a39 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.005633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.006246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.006524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.006829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.007225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.007535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:58.007834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.009195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb72e3-19b3-414a-a726-0d30fce869f8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.021966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 377/746] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:58.021966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.021966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.021966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.038457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:58.039802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:58.046302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ad441-5135-4d1e-990c-dbffaa20d617 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.058226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.084053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.084788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.085144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.085483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.096187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.097794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.114757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 378/747] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:51:58.114757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:58.114981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:58.115838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 370/748] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:58.116741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.227233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa232d73-921e-4f6d-8fde-b50b45b3542f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.228846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27aa7-b993-4f19-9f81-c182014ebc84 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.248246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.265201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.265819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.266096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.266367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.267082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:58.275017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.275172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.275172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.275172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.275172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.275459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.281532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.287020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 379/749] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:58.287190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.287272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:58.304755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:58.305887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 371/750] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:58.311763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.313036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.399669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dcbdd-4986-45f2-91fe-1c5d320feaaa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.420074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd9578-2c41-48fd-961b-130eb658749c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.438283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.438933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.439218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.439493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.440184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:58.440488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.442967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.455267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.455882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.456160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.456439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.457120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.458480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.460335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 380/751] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:58.461146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.533003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.539641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 372/752] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:51:58 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:58.541466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.577435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb3f2-91ad-45c0-94ff-937043c172be None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.585817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.630095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.633735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.633735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.633735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.643886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.645919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:58.665031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:58.666241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:58.667433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:58.670588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 381/753] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:58.671734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.697330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a4392-4bc2-4b1a-a60f-c321331ec72f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.754940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.755821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.756118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.756382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.757200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:58.757384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.758889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.777333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 373/754] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:58.778073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.805996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d635fc-253e-4552-820f-f24af1975782 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.836501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.843196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.844133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.844601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.845085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.853624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.855458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:51:58.867689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:58.868658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:51:58.869577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:58.871820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 382/755] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:58.872832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.886475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.898369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc60872-61d0-46ff-937c-87ccbeef3e39 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.936897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.937521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.937857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.938130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.938910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:58.939215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.940758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.959026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 374/756] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:58.960039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.987393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363a3dd-c5c7-4d8f-8c73-50ea5e591d03 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.025188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.026174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.026652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.027228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.037549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.039331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:51:59.052626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:59.053622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:51:59.054577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:59.057362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 383/757] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:59.058352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.074222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c47e3-6a2e-4e83-8663-682d5680049c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.111876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.112551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.112889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.113287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.113931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.114238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.115802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.120488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.130338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 375/758] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.131229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.145003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.177831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc658b8-bf27-4da1-b8aa-c773ebcef041 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.215065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.215759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.216042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.216306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.217087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=d176ff80e8f04492854430a646c90317) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.217392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.218849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.224653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 384/759] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/role_assignments?user.id=d176ff80e8f04492854430a646c90317&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.225454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.254506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18314-b275-493d-8157-0fa4889dd220 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.294424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.295299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.295677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.296063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.296964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.297347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.298946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf677cc-ee61-4144-aa38-2327ea50014a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.322924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 376/760] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.324609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5719-aeb5-45f1-a54b-2d20e3c9c46c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.325062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5719-aeb5-45f1-a54b-2d20e3c9c46c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.325498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5719-aeb5-45f1-a54b-2d20e3c9c46c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.332134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 377/761] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:51:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:59.333460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5719-aeb5-45f1-a54b-2d20e3c9c46c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.361239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee9cf-808a-4198-84ed-126342da0ad9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.377863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.411775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.412409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.412690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.412965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.413763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=57923b067b6e441ea8d516d830cdf7de) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.414082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.418370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922875e4-5abd-49dc-9731-4f6c67b5ed41 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.418490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.424285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 385/762] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/role_assignments?user.id=57923b067b6e441ea8d516d830cdf7de&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.425361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.425646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.425921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.449247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:59.450564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.468538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5719-aeb5-45f1-a54b-2d20e3c9c46c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.513688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.514702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.515212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.515664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.529331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.531194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:51:59.568862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:59.569866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:59.570792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:51:59.570792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:51:59.570792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:51:59.570792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:51:59.576167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 378/763] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:59.582744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.600065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 386/764] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:51:59.625567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.792346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80cf3-7fb5-41c0-a475-e235d94bee5b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.830471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311042c-2fbb-4d71-b57e-563df0cb9af0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.841412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.850603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.872431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.873050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.873325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.873596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.874282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.874640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.876038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.898575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 379/765] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.900279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.908921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.909964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.910474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.910978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.911813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.913379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:51:59.927542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:51:59.928487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:51:59.929357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:51:59.941404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 387/766] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:51:59.947541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.018736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40ac70-6fa8-49aa-a993-e0c6aa981a7b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.053691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.056119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.056119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.056119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.071289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.072745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:00.094957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:00.096090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:00.097819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 380/767] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:00.105894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.140673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb5f0-7181-4bde-9b5a-405da8c27186 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.155209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.219785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fc043-6c22-4d4c-b79b-ab11b11c3a5d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.220640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.221266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.221549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.221932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.223294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:00.229236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.229236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.238623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 388/768] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:00.244286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.265232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.266611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.267129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.267406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.270411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:00.270851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.273046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.288441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 381/769] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:00.298738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.306030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.411412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f37564-d5d8-45ec-b23d-9de19facfd7a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.413986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.419456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7a9e5-ccf5-4f1d-8f20-1d2b62abe138 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.460920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.461984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.462506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.463002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.465410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=1035c2a2b6b8440a9d975751de4724da, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.467067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.471947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.473257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.473528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.473831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.474476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:00.479599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.479599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.486817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 389/770] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:00.488273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.561264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 382/771] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:00 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:00.591733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.594539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ba5fd-bb48-4a74-91ec-fd9888582934 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.631514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.632151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.632479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.632750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.633516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] RBAC: Adding query filter params (interface=public, service_id=91d5cf2569d64ac2a472e8c9058739fa, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:00.633823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.635322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c312-0881-4f53-94fa-1d515b5f1f1e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.648538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 390/772] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/endpoints?service_id=91d5cf2569d64ac2a472e8c9058739fa&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:00.649952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.814875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9a65-d00a-405d-85f2-2c8c86ed0961 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.815804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9a65-d00a-405d-85f2-2c8c86ed0961 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.816812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9a65-d00a-405d-85f2-2c8c86ed0961 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.818651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 391/773] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:00.822827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971ef62-8dff-4d68-b737-4944c8b95def None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.825407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.825693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.825969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.852014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:00.853200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.866030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.866965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.867396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.867872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.868689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.870323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.876797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 383/774] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:00.933137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 392/775] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:00.956997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.996468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:01.093977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4ede-57da-4338-a251-8ac5d68e69fa None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.132372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.133070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.133345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.133664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.134293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.135684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:01.145522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:01.146588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:01.147503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 384/776] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:01.152847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.262761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:01.271612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0d92-b600-4de8-9acd-8e98bf38c4b6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.321573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.322211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.322489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.322800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.323483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] RBAC: Adding query filter params (name=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:01.323785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.325161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.330493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 393/777] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:01.336792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.451203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:01.465770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aa7be-941a-40d7-ae0a-327f83a12da6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.504572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.505191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.505467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.505740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.506419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] RBAC: Adding query filter params (type=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:01.506741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.508122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444089f-e9d8-4936-b0cf-8abe08cc9624 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.513881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 385/778] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:01.520088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.581551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb911cb-bc20-4ec5-b41f-b834abff7a5d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.581900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb911cb-bc20-4ec5-b41f-b834abff7a5d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.582074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb911cb-bc20-4ec5-b41f-b834abff7a5d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.583577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 386/779] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:01.595010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.595281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.595531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.635785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:01.636990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:01.644362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c14a4-e5b1-43ed-a562-d1c31c53f781 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.736417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.737056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.737339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.737654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.739120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] RBAC: Adding query filter params (interface=public, service_id=1a0e4b4594e84655a320a09a02416ff3, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:01.739431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.740818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.753897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 394/780] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/endpoints?service_id=1a0e4b4594e84655a320a09a02416ff3&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:01.760210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 387/781] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:01.760970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.784365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.807749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:01.889619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:01.908723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf154ff-9ebb-4dfa-ae76-852a4fe0211c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.952517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba1e5b-0723-4fdc-9529-e117d89fddc8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.955316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.956036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.956924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.957281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.968872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3f3d3265-135b-4500-a206-0ab8c36c09cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:01.974875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:01.975830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:01.976697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 388/782] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:01.977431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5445-e099-4a75-ab96-71f030270a6b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.978736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5445-e099-4a75-ab96-71f030270a6b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.978736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5445-e099-4a75-ab96-71f030270a6b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.984145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 389/783] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:01.985140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc5445-e099-4a75-ab96-71f030270a6b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.000856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.001870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.002250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.003114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.004333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.006420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be30d-4490-4e2a-9f38-d0259f9c31a7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.013671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 395/784] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:02.015054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.015439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.015817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.040725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:02.042140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.159128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 396/785] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:02.181859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc5445-e099-4a75-ab96-71f030270a6b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.208347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.225601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.246266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.246992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.247274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.247549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.248580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:02.248959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.251254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.263448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 390/786] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:02.269598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.274191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.346992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a60d-b549-4d40-a08a-adf2606251ec None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.402166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224e75-54c6-4f05-a552-283383179473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.402951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990405-f209-473f-b4dc-e4b781361975 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.403444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224e75-54c6-4f05-a552-283383179473 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.403915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224e75-54c6-4f05-a552-283383179473 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.404397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224e75-54c6-4f05-a552-283383179473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.432326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08224e75-54c6-4f05-a552-283383179473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-08224e75-54c6-4f05-a552-283383179473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:02.437600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:02.438543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:02.439460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:02.442528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 397/787] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:02.448586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224e75-54c6-4f05-a552-283383179473 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.449169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.449890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.450225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.450513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.467573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.469695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:02.489156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:02.490161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:02.491115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:02.491115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:02.491115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:02.491115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:02.491115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 391/788] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:02.496273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.586415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.603358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.634062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224e75-54c6-4f05-a552-283383179473 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.690145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791b1cb-3074-4349-9a4c-950c0879436e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.714433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.715074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.715355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.715625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.716451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:02.716756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.718113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.737033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 398/789] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:02.747710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.758318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.759667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.759667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.759667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.763881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:02.764190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.765566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.792013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 392/790] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:02.797144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.931709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37d6d0-b885-46eb-aa6d-aae33b79b179 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.979875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed5f6-4a76-4776-973a-f9a422ef0449 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.996773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.997422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.997697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.997960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.009943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.012899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.019888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.021349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:03.042426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:03.043675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:03.044596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:03.044596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:03.044596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:03.044596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:03.044596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 399/791] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:03.050071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.050701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.051015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.051291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.052728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.063016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.067620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:03.086052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:03.087119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:03.088114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:03.091371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 393/792] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:03.096151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.250782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a329-020a-4401-a66b-fc93b26fcff6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.262002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681f85-b4c5-4622-9388-da764bec8f5a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.294962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.295944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.296463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.296958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.297644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.298089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:03.298266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.298542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.298850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.299201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.299645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:03.299949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.301910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62406c-d6b2-4b83-b0a6-48b6568b86d6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.302036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c3c11-95db-4804-8da3-b7e523aaa2e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.317404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 400/793] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:03.319560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c9d7-afde-423c-bf29-91ea709f7202 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.320209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c9d7-afde-423c-bf29-91ea709f7202 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.320798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c9d7-afde-423c-bf29-91ea709f7202 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.322494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 401/794] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:03.323402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c9d7-afde-423c-bf29-91ea709f7202 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.326995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 394/795] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:03.328428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.328801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.329199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.352540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:03.353836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.383859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.388591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.427466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 395/796] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:03.428323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.448220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c9d7-afde-423c-bf29-91ea709f7202 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.486434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.487650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.488655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.489147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.496670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.498221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2c0789c6-d706-424a-871c-85ea835608b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:03.510122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:03.511163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:03.512132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 402/797] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:03.512732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe95d-03a1-424c-b8dd-6b7705e8cf03 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.512732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe95d-03a1-424c-b8dd-6b7705e8cf03 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.513452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe95d-03a1-424c-b8dd-6b7705e8cf03 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.518428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 403/798] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:03.519762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe95d-03a1-424c-b8dd-6b7705e8cf03 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.550012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc3a8-4a1e-4e9a-8482-7ed29bad7879 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.587173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.587815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.588095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.588368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.599047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.600494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:03.614903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:03.615812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:03.616705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:03.616705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:03.616705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:03.616705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:03.616705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 396/799] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:03.617477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.635917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe95d-03a1-424c-b8dd-6b7705e8cf03 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.637952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.648892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.671894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.672528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.672809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.673087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.684011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d3641237-8ed1-40a0-9816-b020d13d0830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:03.688897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:03.689949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:03.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 404/800] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:03.692777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.692777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.692909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.714308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:03.715467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.737318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036aa913-8d53-473f-a800-9b97ab995f42 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.773211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.773753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.774063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.774341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.775185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:03.775506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.776941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.790747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 405/801] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:03.790747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.806863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 397/802] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:03.808060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.889342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.891411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.892048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc06ba7-e19a-4a4c-a813-c21197d19b51 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.919400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df602ac2-ef20-4dec-8d79-7f0adca8d95d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.928268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.928889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.929171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.929445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.930138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:03.930467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.932062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.943993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 406/803] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:03.944815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.962623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.963555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.964002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.964417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.965268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:03.965740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.967148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.981390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 398/804] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:03.981390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.056516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d1d6d-a54d-42ed-b378-dad5dc67bc1c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.089398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8620b-a9ff-4570-8615-d041a8665047 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.091247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.091894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.092178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.092455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.093084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.094448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:04.104563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:04.105546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:04.106411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 407/805] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:04.107766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.133272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.137849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.138874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.139645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.140380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.145363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.154431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.156129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:04.171728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:04.172661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:04.173581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:04.173581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:04.173581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:04.173581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:04.173581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 399/806] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:04.174374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.215051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635aca6-bad4-44e5-8ece-1bc1cd4bf86e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.250541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.251487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.251812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.252092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.260430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.262009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:04.274462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:04.275604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:04.276816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:04.280363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 408/807] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:04.281061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.283290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30914aec-c82a-450d-9962-d4adbe197f50 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.319774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.320543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.320825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.321103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.331981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.333455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:04.348354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:04.349507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 400/808] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:04.350579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.375388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.390211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91e61b-153f-4e61-8438-296e10f9d951 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.395901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.424347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.425064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.426003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.426284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.426991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:04.427296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.428662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.433126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 409/809] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:04.433893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.455542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676effed-f5bc-48fe-8ccc-3c3f7a77514e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.489038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.489731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.490083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.490424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.491210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:04.491582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.493007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.504670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 401/810] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:04.505521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.533494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43811149-a223-47c4-acce-cf27174ebcaa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.567041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.567651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.567930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.568205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.568981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:04.569283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.570793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b855f4-bda3-47f2-9189-8198129e679a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.582297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 410/811] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:04.583506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709d1d-ff01-4cbf-85f5-727a731a3445 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.583794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709d1d-ff01-4cbf-85f5-727a731a3445 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.584066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709d1d-ff01-4cbf-85f5-727a731a3445 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.585444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 411/812] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:04.585971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75709d1d-ff01-4cbf-85f5-727a731a3445 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.596306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.604523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.607289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d4617-3dcf-4b96-b76a-4e3006239509 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.640696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.641309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.641587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.641862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.642549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:04.642880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.644282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.655559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 402/813] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:04.656342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.687414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75709d1d-ff01-4cbf-85f5-727a731a3445 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.721229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.721837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.722648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.722979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.723647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:04.723946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.725355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.729987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 412/814] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:04.730753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.760113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb369d9-e39f-49b9-b4de-ce5fee760dd7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.794507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.795176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.795491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.795769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.799929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.802643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.804159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2ecd2040-4c93-43a3-8168-ea236fe4bae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:04.816295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:04.817317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:04.818239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 403/815] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:04.818914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.819093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.819388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.834336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc442e4-f512-4aa8-8f0c-90ff729bddf5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:04.837117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:04.838303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:04.852648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:04.868250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:04.868935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:04.869220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:04.869495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/d176ff80e8f04492854430a646c90317/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:04.884482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=d176ff80e8f04492854430a646c90317, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:04.885963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:04.903871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 404/816] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:04.904781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:04.966163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 413/817] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:04 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/d176ff80e8f04492854430a646c90317/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:04.967284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.016005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e9281-95f1-4fe4-995c-dddd0800bba1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.057168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.057919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.058198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.058468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.066767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.068243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:05.080909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:05.082570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:05.083816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 405/818] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:52:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:05.084474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.092822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044410f5-6a4a-4ebc-8d18-650c42b54f94 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.098180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.124279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.138465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.139117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.139393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.139676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.140416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.145903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.196636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4bf2c-d962-4b34-8adf-d817da425c5a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.230969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.231615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.231898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.232175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.232925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:05.233239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.234932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.247199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 406/819] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:05.259072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.259194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 414/820] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:05.259194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.346612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.390619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5530a20-7829-4f17-9f60-406908a52642 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.404986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf83b5-3a01-444a-9fad-89d217bfdc82 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.432984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.434566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.434566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.434566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] PATH_INFO: `/v3/services/network` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.435003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.437093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:05.448202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:05.449370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:05.450241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 407/821] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:05.451135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.455768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.456974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.457239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.457507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.458761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:05.458884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.460790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.482668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 415/822] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:05.487403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.525414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.592331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6132b8-43f6-47a9-93bb-e00baadd5b8b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.600586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667159a-151d-4e2e-9a9f-2691f7cec495 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.635652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.636669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.637115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.637629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/57923b067b6e441ea8d516d830cdf7de/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.640098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=57923b067b6e441ea8d516d830cdf7de, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.641731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.641991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.642556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.642978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.643354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.644178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:05.644628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.645515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.648039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.653120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 416/823] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:05.655374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.717520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 408/824] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:05 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/57923b067b6e441ea8d516d830cdf7de/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:05.719341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.828238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:05.845815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6ead-b951-401d-8756-2f598d0b3ee6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.856346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060a4f9-f094-4676-aede-79c3c3f86316 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.899969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.900757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.901119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.901460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.903037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.903865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.904332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.904934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.906658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] RBAC: Adding query filter params (type=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:05.907208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.908820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.916409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 409/825] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:05.921899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.985484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.987043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.995643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.044087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af68c-5017-4280-be35-00fd5d82626e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.111266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.113422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.114685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.115213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.118002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.124423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.172232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.173164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 417/826] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:06.174269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.278779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 410/827] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:06.285249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bebea-96a0-4063-9062-f1786cb32f6f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.336087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.336750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.337028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.337300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.351968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.353576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:06.371425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:06.372369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:06.373310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:06.373310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:06.373310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:06.373310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:06.373310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 418/828] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:06.380478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.520062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a3c4f-1b28-4515-86d5-1dcd2d8e50ab None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.536249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.558430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.559137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.559417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.562372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.562372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:06.562372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.562372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.575110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 411/829] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:06.580617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.632463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.704104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f68a-c165-4263-80c8-3f4e6e11169c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.740336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.741290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.741778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.742230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.749635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.751360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:06.763238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:06.764209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:06.765221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:06.767344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 419/830] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:06.773638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.886741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1399f69-cec4-4dae-a437-38b92d16a530 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.930467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.931169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.931452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.931726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.932474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:06.932779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.934248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd47ce-d2c2-414d-9833-09e7a9d56d14 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.946814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 412/831] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:06.952719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.057240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0b95-607c-4f5a-8bd1-1e9619a53865 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.071112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:07.096808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.098001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.102873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.102873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.102873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:07.102873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.102873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02435e0-941c-41df-a7f1-6d8ac0b3dadd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.107824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 420/832] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:07.116229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421e8e6-3090-43d0-908d-bbcf6b825eeb None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.117198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421e8e6-3090-43d0-908d-bbcf6b825eeb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.117676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421e8e6-3090-43d0-908d-bbcf6b825eeb None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.119714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 413/833] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:07.125960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.126320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.126771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.147348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:07.148504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:07.226345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 421/834] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:07.250831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421e8e6-3090-43d0-908d-bbcf6b825eeb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.293271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:07.365637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421e8e6-3090-43d0-908d-bbcf6b825eeb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.404248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.404807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.405083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.405355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.418292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:07.423347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:07.424298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:07.425189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 414/835] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:07.431183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.532515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:07.537368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f38ba-51df-4685-ab5d-9e2fc5aefa38 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.574051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.574669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.575010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.575282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.576033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:07.576335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.578750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9538-c6e0-4351-a88a-6adc46ca4022 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.588536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 422/836] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:07.594038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.607443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdaf4b-944b-47c7-a497-42acb05928b0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.607757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdaf4b-944b-47c7-a497-42acb05928b0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.607987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdaf4b-944b-47c7-a497-42acb05928b0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.609581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 423/837] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:07.614922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.615208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.615488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.635598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:07.636796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:07.718734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 424/838] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:07.726164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:07.733006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e8887-1f24-42a5-a818-1b24ac5f8d17 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.735111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.781865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.783474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.783997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.785212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.802176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.804840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:07.825097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:07.826043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:07.826992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:07.826992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:07.826992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:07.826992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:07.832670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 415/839] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:07.835123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.849407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:07.859544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfafc1-6c48-42df-8dc4-b5c591c95784 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.907512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.908722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.909268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.910028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.911163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.912884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:07.923339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:07.924357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:07.925761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:07.933727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 425/840] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:07.934866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.956453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c637-1bef-41c7-adce-5f20aa96ce11 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.993479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.994112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.994441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.994743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.995439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:07.995744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.998174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65507-32c4-44b5-ad58-d08c196d6fa5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.015873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 416/841] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:08.018050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f19bc-8c75-4255-8d78-67b75fb60e9d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.018342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f19bc-8c75-4255-8d78-67b75fb60e9d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.018619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f19bc-8c75-4255-8d78-67b75fb60e9d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.020351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 417/842] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:08.021067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f19bc-8c75-4255-8d78-67b75fb60e9d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.029866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.051557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f5a4d-b0f1-4111-82da-ea709c99f14e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.091524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.092149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.092475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.092952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.094173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:08.094505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.096516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d350-c9cf-45a4-8aac-a23ea17410a8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.107686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 426/843] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:08.107686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.107686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.107686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.128197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f19bc-8c75-4255-8d78-67b75fb60e9d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.128681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:08.130028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:08.146737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.163366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.164265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.164709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.164988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.172868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.174313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:08.186610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:08.187632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:08.188647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:08.192770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 418/844] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:08.193564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.218934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 427/845] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:08.220254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.264218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.303978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68064-10aa-4700-90a3-3945870d913d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.339246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.339815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.340092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.340370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.341020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:08.341318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.342471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824e45a-c162-47a0-91bc-bc57c733d990 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.342944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.355010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 419/846] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:08.355010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.388752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.389598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.389884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.390162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.391005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:08.391317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.393077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.416507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 428/847] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:08.422823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.433688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.479714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943aaf6-2b8d-467d-b5d1-86b92ec53de4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.516413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.525497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.525762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.526042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.526316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.539123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:08.539860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e174ec-0a30-4ad0-90e1-dcab224e1872 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:08.544769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:08.548926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:08.550046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 420/848] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:08.552199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.588248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.589121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.589475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.590535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.663734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12e80b-5475-46b3-848c-298216a62fba None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.682909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.687368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.698746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.710129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.712497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.712497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.712497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.712497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:08.712497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.714111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.728609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 421/849] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:08.730249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.787544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.820624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 429/850] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:08.826176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.842476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3c091-6f6f-45a3-a18e-cc121971ea2c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.879666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.880382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.880653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.880996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.892535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.895022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:08.911891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:08.912857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:08.913786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:08.913786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:08.913786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:08.913786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:08.918027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 422/851] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:08.919329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:08.955417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd5f4-fe39-4069-a3af-b7ab238ab7c1 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.965666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.000000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.001812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.002411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.002921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.017491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.020672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.028776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17d999-54fd-4e8a-a0a1-64af4e0fdd1a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.031305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:09.041774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:09.043606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:09.044617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:09.044617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:09.044617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:09.044617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:09.046854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 430/852] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:09.053373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.076820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.077801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.078835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.079320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.080487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:09.081244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.083927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.101911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 423/853] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:09.107797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.169165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4e6a6-8e18-4cd7-a9b0-f43063fb60a2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.204935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.205935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.206454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.207179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.208094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:09.208599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.210165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.220366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c446f-d853-49b9-ac5b-a1eada05fa88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.228401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 431/854] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:09.229583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.249227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.263109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.263610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.263948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.264223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.274705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.276629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:09.295479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:09.296532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:52:09.297501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:09.301537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 424/855] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:09.303266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.339080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.343012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20098-78ab-41e7-99b7-d928664ca537 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.380011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.380709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.380986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.381281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.388018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.389435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d56cd6a8-761e-4363-9ff7-73231a2648df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:09.401539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:09.402481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:09.403427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:09.407625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 432/856] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:09.408522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a86d-2c67-497b-bdf5-45d53eeb10c2 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.408801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a86d-2c67-497b-bdf5-45d53eeb10c2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.409072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a86d-2c67-497b-bdf5-45d53eeb10c2 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.411157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 433/857] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:09.411688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830a86d-2c67-497b-bdf5-45d53eeb10c2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.429567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dacf70-111e-4557-87cf-95cd721d9bbc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.466927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.466927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.467199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.467434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.468164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:09.468468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.469893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb86abd-ef0e-452d-b857-e7c5b857a960 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.492810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 425/858] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:09.492810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.492810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.492810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.503677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.509370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:09.510647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.528548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830a86d-2c67-497b-bdf5-45d53eeb10c2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.565378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.566350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.566637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.566939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.567695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:09.568005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.569861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.590738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 426/859] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:09.590738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.599089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 434/860] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:09.601300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.602257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.694897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386cf1c-5a7d-4c6d-bfc4-6990679f0294 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.721553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059baa-402d-438d-adca-01497cfb60e0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.734048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.734662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.734964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.735241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.757674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.758289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.758572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.758876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.759687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=d176ff80e8f04492854430a646c90317) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:09.759994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.761423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.774806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 435/861] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/role_assignments?user.id=d176ff80e8f04492854430a646c90317&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:09.774806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.779032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.828411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.830681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.851513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:09.892394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fed927-1c3d-4b0b-9550-95a4ffabdb06 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.934435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.935246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.935594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.935939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.936648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.938558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:09.951028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:09.952023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:09.952881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:09.955900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 436/862] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:09.962194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.973388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 427/863] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:09.979230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.052960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.100450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b82dc-4812-4acf-ad2d-d4e34149ca0e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.105007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fdb0-9d5c-4985-846c-17e38655cf5c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.119941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.137731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.138354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.138636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.138996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.139999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:10.140312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.142063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.143053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.143702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.144011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.144288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.147640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 437/864] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:10.156264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.160424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.160557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:10.173806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:10.174807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:10.176471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:10.176471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:10.176471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:10.176471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:10.176471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 428/865] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:10.181612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.267030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac6ff-b96b-44af-bc5c-bb1015c8fd66 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.289349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ab410-6f3d-4328-9ced-682722b893c3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.298815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.305765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.306566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.307019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.307457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.308283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:10.308729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.310238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.320807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 438/866] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:10.327540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.328181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.328465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.328817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.329531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:10.329835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.331385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099e09e-0f05-424a-b6c9-896d66943b4b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.345980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 429/867] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:10.352310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.420606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797f2c-cca8-4a8c-9a6b-5f6871854515 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.420952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797f2c-cca8-4a8c-9a6b-5f6871854515 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.421161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb797f2c-cca8-4a8c-9a6b-5f6871854515 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.422805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 430/868] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:10.429219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.429531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.429761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.450153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.451496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.473522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.482181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ad3ee-7c39-4774-a1ba-28c4f8b02ad6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.529033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.529747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.530316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.530316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.531754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 431/869] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:10.540997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.544351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:10.555251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:10.556237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:10.557444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:10.558311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.558395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 439/870] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:10.562385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.636624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.671273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68581e-ce12-4aa8-992a-46633d0ac282 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.713704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6ba8-c1c6-4705-b038-23ac66becbe3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.722947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.723710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.724083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.724448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.725242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.726787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de6ca-86d6-4638-b509-bdde4fcb0532 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.754676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.755325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.755597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.755870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.756607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:10.756909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.758321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.771357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 440/871] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:10.777235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.806921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 432/872] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:10.901495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02368eb-7352-4a2c-b803-4b616748167f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.918175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.947622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.948258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.948606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.948890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.949687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=57923b067b6e441ea8d516d830cdf7de) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:10.950002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.952862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771e7bb-a9c2-42d5-aa4f-23c3f9cba3d2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.960002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 441/873] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/role_assignments?user.id=57923b067b6e441ea8d516d830cdf7de&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:11.977754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae462-6a2f-4406-85d0-1698ccf94454 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.978343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae462-6a2f-4406-85d0-1698ccf94454 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.978343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae462-6a2f-4406-85d0-1698ccf94454 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.979998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 433/874] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:11.985748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.986250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.986362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.006827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:12.009434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:12.086823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 442/875] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:12.110843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae462-6a2f-4406-85d0-1698ccf94454 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.129936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.221303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae462-6a2f-4406-85d0-1698ccf94454 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.258400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.258992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.259269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.259540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.270956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:12.277132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:12.278096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:12.278989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:12.282348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 434/876] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:12.285887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.389562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e92e53-2ca6-4148-ac0d-5e8d668aca8d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.391970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.427461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.428142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.428418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.428736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.429452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:12.429750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:12.431318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d6de-7467-43b4-b9d0-b3c086468f75 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:12.443782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 443/877] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:12.447258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.448204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da558b1b-e87e-473b-a1e0-ce6aacadaaba None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.448491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da558b1b-e87e-473b-a1e0-ce6aacadaaba None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.448775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da558b1b-e87e-473b-a1e0-ce6aacadaaba None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.450483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 444/878] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:12.455438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.455720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.455993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.477153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:12.478448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:12.547916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.559035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 445/879] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:12.574773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545c67-9310-4a48-9835-d3432f1f7e73 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.575069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.620634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.621634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.621913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.622188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.636707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:12.638304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:12.653948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:12.656103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:12.658311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:12.658311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:12.658311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:12.658311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:12.662916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 435/880] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:12.662916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.678570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.692033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb8a0-3d87-45f1-ae78-7878446e9a59 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.737784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.738913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.739342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.739866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.740707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:12.742230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548abd6-c82f-44ea-a4cf-a2d4b9ab1ee7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:12.772618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e84c66-dc6f-46d0-89a1-89891437d68b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.801040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.809896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.810516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.810855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.811098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.811779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:12.812078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:12.813501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:12.831064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 446/882] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:12 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:12.831269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 436/882] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:12.833424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.924923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5638-358d-4d8e-8e62-e9b62008ae3c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.926142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5638-358d-4d8e-8e62-e9b62008ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.926661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5638-358d-4d8e-8e62-e9b62008ae3c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.929936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 447/883] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:12.936499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b1eb-aed6-4d08-8c82-e3a6ef3dd6ef None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.936499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b1eb-aed6-4d08-8c82-e3a6ef3dd6ef None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.936499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b1eb-aed6-4d08-8c82-e3a6ef3dd6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.954873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b4df0-427c-45e7-a808-25025fba4cd1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.959848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2ce1b1eb-aed6-4d08-8c82-e3a6ef3dd6ef None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:12.961062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2ce1b1eb-aed6-4d08-8c82-e3a6ef3dd6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.008793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.009691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.009973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.010889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.020028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.021922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5488fb7b-e537-4548-99d6-76fe0720b9f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:13.035130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:13.036174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:13.037138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 437/884] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:13.037736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fea38-a3d5-4c78-898d-c60feabb45b9 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.037736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fea38-a3d5-4c78-898d-c60feabb45b9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.038137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fea38-a3d5-4c78-898d-c60feabb45b9 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.039543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 438/885] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:13.041832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fea38-a3d5-4c78-898d-c60feabb45b9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.052625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 448/886] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:13.054142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.054142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.054353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.073172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:13.073838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.105391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.141545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 449/887] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:13.142394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.168994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.178482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fea38-a3d5-4c78-898d-c60feabb45b9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.213528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.214150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.214429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.214726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.215555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:13.215865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.217298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.236659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 439/888] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:13.237503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.261429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac93e8a-1dce-41cc-9893-7e757f552a42 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.297935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.298986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.299591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.299866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.300568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.302158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:13.311573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:13.312588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:13.314083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 450/889] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:13.314920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.342724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.345779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038f1be-07b9-42cc-8b98-61ba67ad0337 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.383158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.384176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.384649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.385113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.385957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.387559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:13.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:13.398814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:13.399697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:13.406056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 440/890] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:13.406056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.406289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.423401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb62d8e-0dc9-4355-a4a8-7048fda55026 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.460603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.461362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.461736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.462104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.509865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f864d5-95d6-4701-bcbb-0204e7270d0d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.533295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.535033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.547847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.548593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.548977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.549332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.550090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:13.550496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.552157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.561699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 441/891] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:13.561699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.590857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.620670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.646183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 451/892] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:13.646183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.670336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a44047-2c04-465e-94af-0ebedb6b2037 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.713281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.713908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.714189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.714467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.715174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:13.715479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.716848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.721842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 442/893] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:13.722958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.763433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314a37-de33-4899-9b34-b05d76a00239 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.797920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.798694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.799101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.799473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.800733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:13.801132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.802582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.807476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 452/894] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:13.808328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.828962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.838373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c5d7-c126-457d-b998-2c0d5563c005 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.854699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.874934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.875577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.875865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.876145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.887598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.889046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:13.904508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:13.905633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 443/895] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:13.906930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.916303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e798fa-29f0-4d78-9bda-ee68a2538d1f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.953360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.953980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.954256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.954528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.955239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:13.955545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.956934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.962130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 453/896] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:13.962696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.033901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d0388-3184-4f44-962f-ba8181b00293 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.076424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.077331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.077876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.078372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.079508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] RBAC: Adding query filter params (interface=public, service_id=e674ca8db6c4444996c8ad0b9d80c7af, region_id=RegionOne) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:14.079979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.081597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.082394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096913-5648-4368-bb77-3034ab8abacc None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.091606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 444/897] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/endpoints?service_id=e674ca8db6c4444996c8ad0b9d80c7af&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:14.093360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.107224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.120854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.121490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.121827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.122105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.122892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:14.123199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.124605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.124730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.141876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 454/898] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:14.150583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.231987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15e29-2e58-43c6-b094-d7125f69a028 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.260464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efb50-5240-4274-8342-ce6739ba9e42 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.270271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.271005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.271381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.272140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.272889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.275117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.286752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 445/899] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:14.309736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.310867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.311380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.311895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.321454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.323364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:14.337489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:14.338467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:14.339493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:14.342302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 455/900] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:14.351798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.434247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.465804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bcbd9-ecb4-4e78-94c0-35bea6055bbf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.504546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.505218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.505496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.505768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.506621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:14.506958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.508388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae811d-0d21-4047-a967-dda41c450920 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.521829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 446/901] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:14.527572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.560085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.638209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fa3d9-5179-4653-a900-3bb964531ab9 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.674471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.675669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.676136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.676412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.677206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] RBAC: Adding query filter params (role.id=175a15a10f0d440ab08c32f70c2fa388, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=d176ff80e8f04492854430a646c90317) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:14.677515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.678975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031f959-0846-4eda-a664-3c0f4a3b855a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.685448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 456/902] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/role_assignments?user.id=d176ff80e8f04492854430a646c90317&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=175a15a10f0d440ab08c32f70c2fa388 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:14.939452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493489-2ded-43c0-9632-1f7bd4f3f46d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.939645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493489-2ded-43c0-9632-1f7bd4f3f46d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.939915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493489-2ded-43c0-9632-1f7bd4f3f46d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.941542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 447/903] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:14.946834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.947343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.947834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.966403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:14.967927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:15.038690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 457/904] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:15.061732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84493489-2ded-43c0-9632-1f7bd4f3f46d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.178248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84493489-2ded-43c0-9632-1f7bd4f3f46d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.211724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.216716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.217417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.217973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.218245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.218901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.220407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:15.230159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:15.231112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:15.231985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 448/905] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:15.239838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.265847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.342099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69650-5592-4a44-95ca-e473621b7c38 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.376797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.377756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.378316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.378985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.379906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:15.380406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.381975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.387352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 458/906] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:15.393219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.503859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9fc6-4143-4c08-93a3-e89775495b22 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.539358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.540326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.540802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.541298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.542161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:15.542961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.544520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.550788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 449/907] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:15.556955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.643404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.658703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921756-1d84-44c9-ab94-45a2e7ab2548 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.699649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.700392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.700616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.700802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.701567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] RBAC: Adding query filter params (interface=public, service_id=1a6fc95937854642a9d7b4baab685944, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:15.701876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.703281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dda3c-0edc-404b-9e2a-5fab729deef1 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.709136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 459/908] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/endpoints?service_id=1a6fc95937854642a9d7b4baab685944&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:15.714533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.777386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.822688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab886-a6bb-4662-bc3f-31b976559352 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.860044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.860669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.860951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.861229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.861881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.863944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac37ff-22ac-42bd-8f18-fb444150bb0f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.870283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 450/909] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:16.110068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8b32-f373-47d6-9e2f-ff61a3e19bfd None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.110523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8b32-f373-47d6-9e2f-ff61a3e19bfd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.110635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f8b32-f373-47d6-9e2f-ff61a3e19bfd None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.112273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 460/910] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:16.121208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad349-0588-48d5-93db-f1fcb17dd5f4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.121691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad349-0588-48d5-93db-f1fcb17dd5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.121768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad349-0588-48d5-93db-f1fcb17dd5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.145823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-178ad349-0588-48d5-93db-f1fcb17dd5f4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:16.147560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-178ad349-0588-48d5-93db-f1fcb17dd5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.227030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 451/911] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:16.251536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f8b32-f373-47d6-9e2f-ff61a3e19bfd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.365407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f8b32-f373-47d6-9e2f-ff61a3e19bfd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.408761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.409384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.409685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.409929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.410629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.412214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.450122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed5df-c72f-4191-8522-aac66e01ea45 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.450615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed5df-c72f-4191-8522-aac66e01ea45 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.450942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed5df-c72f-4191-8522-aac66e01ea45 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.452315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 452/912] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:16.458231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.458595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.458995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.481443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:16.482634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.490572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 461/913] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:16 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:16.550560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:16.576865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 453/914] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:16.601825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.617424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:16.719320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e73ff-8de2-4c1d-8c1b-7ff62cdec497 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.755189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.756217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.756714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.757191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.758017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.759909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-69cc47a9-9d2b-4ba6-b222-c2a83e62df37 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:16.771263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:16.772276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:52:16.773173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:16.776040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 462/915] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:16.786744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.893637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cc77f-6013-4fdd-a2ef-a5eb9adbd1ec None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.931172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.931380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f49035-24a3-4bba-99d7-6d2f897882de None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.931659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f49035-24a3-4bba-99d7-6d2f897882de None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.931829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.931953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f49035-24a3-4bba-99d7-6d2f897882de None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.932114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.932344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.933031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:16.933334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.933605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 463/916] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:16.934729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.938453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.938755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.939038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.940275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 454/917] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:16.945981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.961364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:16.962734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.994762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.054677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 464/918] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:17.057165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbbd8e-2fd6-4e9b-be29-47c46e08a20e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.080073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.085119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.104473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.105385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.105842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.106276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.107139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.107590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.109153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.116953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 455/919] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:17.126762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.201874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387abb8-8726-4866-912d-8c642ed0a4ed None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.228257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e83a-6290-40a1-8ce7-7e785549f6e5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.238651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.243941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.244943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.245231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.245505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.259158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:17.266618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:17.267577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:17.268429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:17.269413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.269560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 465/920] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:17.269672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.269672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.269672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.269672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.271132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.272822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.342211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.375551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 456/921] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:17.389096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfbf1-536c-48a7-bd30-be577c9500be None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.437303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.437979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.438265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.438538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.439419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.439726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.441432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.451496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 466/922] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:17.457302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.572948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e94dc-5b98-433a-a0ed-e32cd87724b6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.609692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.610582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.611032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.611479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.623116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.624778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:17.640145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:17.641376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:17.642502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:17.642502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:17.642502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:17.642502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:17.645179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 457/923] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:17.650954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.762219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13ddb0-8ad3-4600-b703-dcccebd3994a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.786553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.799016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.799632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.799910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.800315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.804146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.804146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.804146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfb43-8dbf-463a-ba2d-76a5aa7eef0c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.815407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 467/924] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:17.820978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.842975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.930456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f54eb-c41a-472a-b3ca-a4ec42b5187b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.966257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.966946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.967335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.967612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.972230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6b6-fcb2-470d-a912-224a002a7e91 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.972520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6b6-fcb2-470d-a912-224a002a7e91 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.972794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6b6-fcb2-470d-a912-224a002a7e91 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.974403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 468/925] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:17.976076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.977588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.979579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.979861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.980247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:17.990651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:17.991667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:17.992669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 458/926] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:17.999020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.007847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:18.009307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.090794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 469/927] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:18.104938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.111213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.131961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f61de-71f8-4e90-ac7c-958be3829f88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.172301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.173441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.173951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.174422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.175585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:18.176149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.178057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.204071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 459/928] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:18.205433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.215991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f782a6-f022-4755-b7ac-4487c6d2c7be None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.229469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.251578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.252227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.252503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.252775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.253953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.255362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:18.265373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:18.267002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:52:18.268107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:18.275107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 470/929] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:18.277204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.328064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac446db-3af2-467d-b25b-f5edc8cf10e3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.367321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.368237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.368661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.369140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.371504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.381203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.382887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.387046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a47b-1204-4ac0-bb24-c24677bdb90a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:18.399671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:18.408443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:18.410258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:18.410258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:18.410258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:18.410258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:18.410258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 460/930] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:18.411490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.431062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.431953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.432374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.432830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.433731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:18.434176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.435751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.445909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 471/931] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:18.446981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.492377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.520023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85200a99-5b05-4e37-98e6-ce4a49eae1d1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.556792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.557561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.557905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f090981-c140-43ff-9cc8-a76626202514 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.558048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.558379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.559200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:18.559620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.561679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.578647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 461/932] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:18.579737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.607395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.608041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.608373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.608660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.609368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:18.609677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.611112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.623822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 472/933] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:18.625445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.648140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.705609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624505f-f295-46a8-a83e-a0c227f5f99a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.743608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.744250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.744530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.744812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.750124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5fc88-afdd-4774-99fb-2bc5ea935bef None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.751596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.752778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.754594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3c83803c-8e81-49d2-9ea6-49167f94ceae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:18.764905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:18.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 462/934] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028aca-ba05-4df3-8bb5-bd6a2d9a3835 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.772027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028aca-ba05-4df3-8bb5-bd6a2d9a3835 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.772767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028aca-ba05-4df3-8bb5-bd6a2d9a3835 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.772767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 463/935] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:18.775044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028aca-ba05-4df3-8bb5-bd6a2d9a3835 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.795973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe815559-f337-4698-b917-33535529ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.796593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815559-f337-4698-b917-33535529ad65 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.796875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815559-f337-4698-b917-33535529ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.797151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815559-f337-4698-b917-33535529ad65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.797857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe815559-f337-4698-b917-33535529ad65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.799261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe815559-f337-4698-b917-33535529ad65 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.878931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028aca-ba05-4df3-8bb5-bd6a2d9a3835 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.886444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.902011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 473/936] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:18.902011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.902011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.902011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.918851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:18.920683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.935429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.936174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.936462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.936807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.937650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:18.937967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.939631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.954702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 464/937] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:18.961805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.021963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 474/938] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:19.044787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.099794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6ef5f-8e98-4746-a332-91aa0ecb1330 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.144132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.146531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.147059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.147560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/d176ff80e8f04492854430a646c90317/roles/175a15a10f0d440ab08c32f70c2fa388` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.150957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=d176ff80e8f04492854430a646c90317, role_id=175a15a10f0d440ab08c32f70c2fa388)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.152714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.158256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.168139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86008506-ec5d-4fdc-87b4-c107e2966ee8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.202922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.203561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.203842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.204120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.204751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.206178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:19.215630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:19.216702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.218027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 475/939] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:19.223175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.266739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 465/940] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:18 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/d176ff80e8f04492854430a646c90317/roles/175a15a10f0d440ab08c32f70c2fa388 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:19.354763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb06b-da5a-4f48-9548-da653981a43a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.392948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.393834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.394356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.394643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.395437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:19.395814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.397275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d2f4-e52a-454e-8e99-2d4f8139c204 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.403350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 476/941] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:19.409932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.439627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.524836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a3da-5679-4261-aa6d-14db2ce230c9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.532990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47bcd-850a-4a6c-9ea8-a160a7c8b129 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.533470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47bcd-850a-4a6c-9ea8-a160a7c8b129 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.533888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47bcd-850a-4a6c-9ea8-a160a7c8b129 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.536237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 477/942] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:19.541374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.541658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.541932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.562205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:19.564014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.565607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.566385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.566643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.566963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.567643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:19.567945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.569327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.574729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 466/943] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:19.579756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.580480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.653140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 478/944] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:19.678773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.711795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.732304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2c6c-12a8-4bc5-9ca6-a6887d0f4d0b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.777727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.778542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.778960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.779333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.780198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] RBAC: Adding query filter params (interface=public, service_id=d8be247f808046058352ef64c91fd8ef, region_id=RegionOne) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:19.780603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.782076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.788887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 467/945] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/endpoints?service_id=d8be247f808046058352ef64c91fd8ef&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:19.794215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.799774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc4b5-226d-45f9-b9cb-50f9abead854 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.843580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.844622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.845317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.845744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.846574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.849285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.853126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING keystone.server.flask.common [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 12:52:19.901394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614271c-dcbc-4328-95d9-a5307594a8b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.903587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:52:19.903587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:52:19.903587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [parameters: {'id': 'de5cf27c3f8e4b8eade57c716c6ece51', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:52:19.903587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id de5cf27c3f8e4b8eade57c716c6ece51.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id de5cf27c3f8e4b8eade57c716c6ece51. Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:52:19.914537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 03 12:52:19.915552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() Aug 03 12:52:19.916577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:52:19.917735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:52:19.918639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:52:19.919495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'id': 'de5cf27c3f8e4b8eade57c716c6ece51', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.920397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:19.921218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id de5cf27c3f8e4b8eade57c716c6ece51. Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:19.928873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 479/946] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Aug 3 12:52:19 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:19.931720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.936008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.946225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.950612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.950612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.950612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.950612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.950612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.962459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 468/947] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:20.056550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42d437-3a94-4f7d-8f04-f41b2b733599 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.094680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.095379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.095719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.096004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.104624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.106373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f14cc40e-6f2e-4bbf-bc99-635bdf18a45e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:20.119894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:20.120900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:20.121865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 480/948] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:20.129092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.147845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:20.236860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec3640-bdb6-42cb-9db4-288e5e020c5e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.272100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.273097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.273597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.274068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.275020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:20.275537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.277163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1758d-cefc-4edb-8ddf-adfc3fc0905d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.295790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 469/949] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:21.044936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e1b96-b390-46b6-a2b6-3080f8d4a8f9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.045475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e1b96-b390-46b6-a2b6-3080f8d4a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.045475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e1b96-b390-46b6-a2b6-3080f8d4a8f9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.049889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 481/950] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:21.055561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.056108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.056620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.075923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:21.077487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:21.149082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 470/951] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:21.171399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e1b96-b390-46b6-a2b6-3080f8d4a8f9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.243135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.282344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e1b96-b390-46b6-a2b6-3080f8d4a8f9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.317171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.317731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.318013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.318286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.318932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.320408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-c941350c-fda2-42a2-8b80-c5db52d67345 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:21.329347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:21.330618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:21.332701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 482/952] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:21.340311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.343524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.364593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7e939-eeb4-4951-b1a8-55b5d3252f18 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.364925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7e939-eeb4-4951-b1a8-55b5d3252f18 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.365143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7e939-eeb4-4951-b1a8-55b5d3252f18 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.366745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 483/953] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:21.371578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.371871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.372148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.391593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:21.393632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:21.452090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e3732-4d8b-496f-acc0-43c2c3968222 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.471425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 484/954] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:21.499143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.499397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.499861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.500146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.500427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.501124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:21.501430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.503253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.513618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 471/955] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:21.515137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.566395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.588316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.614822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d940b7e-9dd3-4389-a73e-39a819b89df9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.622624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994cab-32bc-4e34-88d1-dab1f571b2f4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.659505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.659505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.659505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.659505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.665816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.666434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.666705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.667014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.667949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:21.668251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.669606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.675168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:21.675442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 472/956] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:21.680983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:21.682052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:21.682957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:21.691263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 485/957] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:21.693387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.810632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc036c-9cde-4c0d-82cd-6e8006d243d3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.844983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.850760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.853752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.853752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.853752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.853752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:21.853752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.855202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.867664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 473/958] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:21.872055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.975083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137748-bca5-4263-bf94-e729c57f0210 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.993550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.010388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.011061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.011344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.011637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.022634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.024331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f7d176b9-da22-499b-9897-9035137d71e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:22.040336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:22.041335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:22.042260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:22.042260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:22.042260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:22.042260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:22.045174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 486/959] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:22.047978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.172324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bca7f4-845b-470f-adae-009c30568837 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.193510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec188-28d2-4104-870e-4ea19e7480d0 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.193852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec188-28d2-4104-870e-4ea19e7480d0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.194049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ec188-28d2-4104-870e-4ea19e7480d0 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.195770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 487/960] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:22.196659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.197289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.197570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.197848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.198541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:22.202508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.202508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.204644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.205136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.205608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.215716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 474/961] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:22.220710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.228752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:22.230789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:22.281331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.322778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 488/962] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:22.334877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b5a8e-bed2-46e7-9aa1-a4cbbbfc4d57 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.343472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.373510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.374455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.374947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.375425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.384035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.385830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:22.399351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:22.400400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:52:22.401393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:22.408570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 475/963] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:22.410221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.451038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.454190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36023d20-f001-4fc4-9b71-5f99b7ea246c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.492944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.493959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.494456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.494956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.495806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.497347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-104fe524-9e18-4f78-bfb6-67d084c5d46e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:22.507859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:22.508890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:22.509847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:22.511972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 489/964] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:22.513260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef6a1-7c5d-4735-b2ec-d8df5d690969 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.513541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef6a1-7c5d-4735-b2ec-d8df5d690969 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.513817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bef6a1-7c5d-4735-b2ec-d8df5d690969 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.515280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 490/965] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:22.518582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bef6a1-7c5d-4735-b2ec-d8df5d690969 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.531146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01631343-130c-4d81-93d7-79aad130f8cf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.549049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.569966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.570589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.570901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.571194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.571970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:22.572278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.573827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7a90-ba9a-4b58-9ca7-45696ac1b5fe None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.592424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 476/966] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:22.593881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.594364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.594874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.612812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:22.613992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:22.635353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bef6a1-7c5d-4735-b2ec-d8df5d690969 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.678492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.679152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.679436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.679706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.680379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:22.680782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.691386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 477/967] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:22.691550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.691662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.698637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 491/968] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:22.705465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.737962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.812797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753f3c9-1997-48a1-86f1-da69718c2c03 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.813403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46f883-d8f8-475b-a9cc-cecdf7215631 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.814340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.851088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.851708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.851984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.852224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.852344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.852946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:22.853063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.853246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.853387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.853714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.854590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.864662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 492/969] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:22.864662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.930318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.931870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.954813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:22.964219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bccbff-fd53-4acb-beb3-d1342650de96 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.001499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.002390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.002676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.002993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.003922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.006129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.035289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 478/970] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:23.036102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.038364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.107884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.sql.core [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:52:23.107884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:52:23.107884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [parameters: {'user_id': 'd69e8f28a85e4cf2bc29ddb736d6caf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:52:23.107884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:52:23.115713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:52:23.118693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application yield resource Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise self.value Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application session.commit() Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:52:23.119977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:52:23.121130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:52:23.122910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application result.read() Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:52:23.124339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd69e8f28a85e4cf2bc29ddb736d6caf7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:23.125480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 03 12:52:23.126442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 493/971] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Aug 3 12:52:22 2022] POST /identity/v3/users => generated 160 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:23.127636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.147167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeba8-c9a8-482b-848d-de8c9f220198 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.185025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.185694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.185914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.186188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.186921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.188299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.264831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6341581-8743-4ae4-9ae7-b8384294175d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.264831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.264831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.264831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.265295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.276266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.277894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:23.291898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:23.293149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 494/972] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:23.294069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.303513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.314066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 479/973] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:23.315183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.409047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.440228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1fd-1ecb-4d41-a24e-2f24b376a4cd None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.468421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933442b-c4fb-4cbb-85ee-d7d85984c923 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.486168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.488024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.488517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.489062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.499965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.501414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.511636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.512256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.512532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.512803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.513492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:23.513792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.515251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:23.516661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:23.517618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:23.518631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 495/974] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:23.523526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.531511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 480/975] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:23.537647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.599452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.636245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f1883-4f12-4042-835b-8ef3aea640f7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.653771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea69e48-9a54-4f8f-8ffe-0966345cc746 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.670447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.675107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.675946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.676371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.676859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.677829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:23.678272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.679889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08a6c5-20de-43d5-98f0-5da6bd60075c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.700531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.701323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.701753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.702148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.710390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.712701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:23.726099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:23.727239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:23.728166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:23.728610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 481/976] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:23.735011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 496/977] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:23.738741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.762792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8e1f-1da1-40b0-94fc-788cc3e418c1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.763128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8e1f-1da1-40b0-94fc-788cc3e418c1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.763367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8e1f-1da1-40b0-94fc-788cc3e418c1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.765069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 497/978] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:23.773449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.773752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.774032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.795480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:23.797226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:23.856834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975508ba-74dd-44ca-b5fc-d2c578c99d23 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.898886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 498/979] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:23.902583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.902989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.903272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.903545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.904311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:23.904614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.906062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.919339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.924999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 482/980] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:23.934320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.974699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.986537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:24.045521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d1359-bebf-4d95-b114-d6825e0e2a59 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.053174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0aedc-e386-419a-bd0c-01918c02fe2d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.084422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.085148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.085428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.085702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.086394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.087817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf873a-5fab-4d75-b708-c576d78993da None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.088122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.088749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.089027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.089297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.090071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] RBAC: Adding query filter params (role.id=175a15a10f0d440ab08c32f70c2fa388, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=d176ff80e8f04492854430a646c90317) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:24.090372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.092044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c6589-8ae8-4a13-95c5-7c91128df539 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.098991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 483/981] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/role_assignments?user.id=d176ff80e8f04492854430a646c90317&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=175a15a10f0d440ab08c32f70c2fa388 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:24.163064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 499/982] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:23 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:25.434154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc62c6-bfdd-4d8e-a61c-a1ca66c54af0 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.434154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc62c6-bfdd-4d8e-a61c-a1ca66c54af0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.434154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc62c6-bfdd-4d8e-a61c-a1ca66c54af0 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.435134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 484/983] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:25.439982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.440351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.440555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.458417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:25.459642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.531410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 500/984] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:25.554431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc62c6-bfdd-4d8e-a61c-a1ca66c54af0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.652338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.657633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc62c6-bfdd-4d8e-a61c-a1ca66c54af0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.701811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.702476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.702779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.703220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.703855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.705217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:25.714523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:25.715684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:25.716545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:25.719065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 485/985] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:25.721700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.764974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.822946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a314c-b1bc-4f2e-ad81-5046e7d50bd0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.859147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.859765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.860037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.860305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.860976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:25.861274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.862702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.872306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 501/986] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:25.873553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.978343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60901-aa82-41ba-a608-a2fe9efb05b1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.011654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.012268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.012548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.012821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.013497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.013799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.015279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc597ae-ed61-4ba7-a84d-6ca0118befab None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.025858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 486/987] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:26.027495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.127412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dede0-5c15-4a0c-8bb0-32510f8eff98 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.130290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.161770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078e9f-6358-433e-ba0c-f36df548c23b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.162092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078e9f-6358-433e-ba0c-f36df548c23b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.162329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13078e9f-6358-433e-ba0c-f36df548c23b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.162981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.163607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.163967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 487/988] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:26.164070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.164156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.164906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] RBAC: Adding query filter params (interface=admin, service_id=d8be247f808046058352ef64c91fd8ef, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.165218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.166580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8264-6387-4e9d-a8af-635e21a50312 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.168864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713b1c-7339-4de5-93cf-b3fa55359da0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.169150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713b1c-7339-4de5-93cf-b3fa55359da0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.169437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713b1c-7339-4de5-93cf-b3fa55359da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.173275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 502/989] 10.222.0.67 () {56 vars in 1249 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/endpoints?service_id=d8be247f808046058352ef64c91fd8ef&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:26.174675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f526-acf6-4955-a270-662594f99219 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.175397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f526-acf6-4955-a270-662594f99219 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.175870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f526-acf6-4955-a270-662594f99219 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.177217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 503/990] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:26.179765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f526-acf6-4955-a270-662594f99219 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.188155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cc713b1c-7339-4de5-93cf-b3fa55359da0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.189355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cc713b1c-7339-4de5-93cf-b3fa55359da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.211203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.257715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 488/991] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:26.258951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.259241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.259683 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.279833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.281322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.283215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f526-acf6-4955-a270-662594f99219 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.317095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.317703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.317980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.318252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.318947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.320294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.326292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 504/992] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:26.327086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.353162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 489/993] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:26.376006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.376798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.455512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e71902-3332-4857-83e1-08bf8cfa912a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.484957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.496762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.497400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.497682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.497955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] PATH_INFO: `/v3/services/image` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.498563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.499957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.505830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4c74-7930-43b4-a249-45645e74225e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:26.512087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:26.513210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:26.514084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 505/994] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:26.519372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.542947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.543808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.544204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.544482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.545108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.546481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:26.556511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:26.557557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:26.558453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 490/995] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:26.563417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.623151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.630386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31233-a33a-4ce0-b296-758db5575311 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.665667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.666462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.666877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.667252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.668283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] RBAC: Adding query filter params (name=image) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.668700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.670391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.676138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 506/996] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:26.677627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0b5a-a97a-415f-aa87-d921c43f7526 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.681843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.715957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.716580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.716858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.717128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.717794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.718090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.719537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.724482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 491/997] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:26.730063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.746061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.798414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe778-2f0f-4acc-aa98-09c66036bc3e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.835871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.836482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.836758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.837216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.837695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] RBAC: Adding query filter params (type=image) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.837988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.839405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.854973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 507/998] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:26.855193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1498b-dc9b-4be3-914f-c28e9c792306 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.882453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547709ea-bd06-4687-9188-225c413b911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.883121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547709ea-bd06-4687-9188-225c413b911f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.883401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547709ea-bd06-4687-9188-225c413b911f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.883675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547709ea-bd06-4687-9188-225c413b911f None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.884361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547709ea-bd06-4687-9188-225c413b911f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.884666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547709ea-bd06-4687-9188-225c413b911f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.886058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547709ea-bd06-4687-9188-225c413b911f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.896742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 492/999] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:26.898432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.929291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.012288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4568b2-6cfe-4fd0-87b2-20601e5f2713 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.047112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.047732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.048011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.048283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.049092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] RBAC: Adding query filter params (interface=public, service_id=d69984e41daf4bed8d41f34b0a3d6d08, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:27.049347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.051385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785f6ff-c9be-4a1e-a402-d69610104e77 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.056872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 508/1000] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/endpoints?service_id=d69984e41daf4bed8d41f34b0a3d6d08&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:27.062451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547709ea-bd06-4687-9188-225c413b911f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.145184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.166932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547709ea-bd06-4687-9188-225c413b911f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.201651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.202266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.202544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.202866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.203596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.205035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f578beb-6b02-4dd8-b32b-16802349bdda None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.211462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 493/1001] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:28.386241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192911-a7e2-4ac0-b15c-91b304c8edca None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.387042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192911-a7e2-4ac0-b15c-91b304c8edca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.387042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7192911-a7e2-4ac0-b15c-91b304c8edca None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.388177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 509/1002] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:28.393381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.393800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.394156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.412808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:28.413978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:28.483719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 494/1003] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:28.506881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7192911-a7e2-4ac0-b15c-91b304c8edca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.598771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:28.611858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7192911-a7e2-4ac0-b15c-91b304c8edca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:28.647009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:28.647583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.647864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.648137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.648764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:28.650120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:28.658939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:28.665910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:28.667006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 510/1004] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Aug 3 12:52:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:28.669417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.749572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:28.783727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fd531-5fec-4562-9ff6-2f20b4754ffd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:28.822444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:28.823088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.823362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.823701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.824371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:28.824670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:28.826024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8920afe-07c7-4319-be17-4159175e9ea1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:28.836464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 495/1005] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:28.837405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.842460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bdb66-4940-4ade-9058-5e52bb7755e1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.842772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bdb66-4940-4ade-9058-5e52bb7755e1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.843050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bdb66-4940-4ade-9058-5e52bb7755e1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.844530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 496/1006] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:28.849902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.850209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.850455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.869091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:28.870262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:28.942522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 497/1007] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:28.945765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ec72-6b3e-4be6-ba84-206ec9eb2b8d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:28.964923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.984249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:28.984910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.985184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.985505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.986184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:28.986526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:28.988255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:28.993536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 511/1008] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Aug 3 12:52:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:28.999057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:29.017242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:29.036272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:29.070438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95cd0c-656d-485e-b6ee-0e6f2bba65a9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.104940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6d30-7ab0-478c-adb9-01696ce5788e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.107494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.108212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.108494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.108763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.109442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.110822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa9360-8bf8-4519-8624-657f137a3123 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:29.138847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.139465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.139743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.140016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.140714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.142073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e8b44-04cd-416a-8697-637bb5a52cb9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:29.184206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 498/1009] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:28 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:29.213449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 512/1010] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:29.217100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4427-eb2f-40e0-be74-953ae507a6e7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.217389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4427-eb2f-40e0-be74-953ae507a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.217668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded4427-eb2f-40e0-be74-953ae507a6e7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.219361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 499/1011] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:29.225250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.225554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.225815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.246535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:29.248422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:29.334788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 513/1012] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:29.357504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded4427-eb2f-40e0-be74-953ae507a6e7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:29.466264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded4427-eb2f-40e0-be74-953ae507a6e7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.493211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:29.502171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.505558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.505558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.505558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.505558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.505558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:29.514755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:29.515748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:29.516625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 500/1013] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:29.522911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:29.525221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:29.622316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b3cb6-dede-45c8-a1b8-cfb63e34c107 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.655910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.656532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.656809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.657084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.657765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:29.658068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.660020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:29.665032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 514/1014] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:29.670932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:29.777560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfde3d-4a65-47e4-ae04-22440ac12653 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.812518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.813142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.813424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.813701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.814430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:29.814757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.816170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775e792-f689-487a-a3f6-4c691dc9b791 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:29.825577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 501/1015] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Aug 3 12:52:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:29.826681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:29.895152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:29.929597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb8358-4c7f-47e5-8297-62250709afd5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:29.965447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:29.966068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:29.966348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:29.966622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:29.967356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:29.968725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfca3d5-4146-4aab-b59e-51264385d66e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:30.045859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 515/1016] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:31.243943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b790-79c9-4376-baca-7f000c11e189 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.244503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b790-79c9-4376-baca-7f000c11e189 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.244503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b790-79c9-4376-baca-7f000c11e189 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.250003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 502/1017] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:31.250133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735fe95-a9d6-4ba3-a2b5-68b222f946a6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.250133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735fe95-a9d6-4ba3-a2b5-68b222f946a6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.250133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735fe95-a9d6-4ba3-a2b5-68b222f946a6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.251326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 516/1018] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:31.251619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.251901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.252179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.256864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.257138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.257407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.277494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:31.278730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:31.285343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:31.286513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:31.334352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:31.360681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 517/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:31.362888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 503/1020] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:31.381878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.382763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.438538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:31.486500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3126f4-97fa-4c98-8e2a-f3555aed2c8c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.487024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cef41-0602-41f0-9de0-e17a1e54abaf None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.523813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.524377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.524660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.524935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.525289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.525564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.525984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.526302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.526579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.527032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.528088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.530311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.532133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 518/1021] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:31.536420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:31.537412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:31.538287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:31.541409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.542459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 504/1022] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Aug 3 12:52:31 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:31.543459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.589837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:31.647783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ce80-4a5b-4972-8c67-65d1cb547af8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.662189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921a3c5-269e-403e-8c3e-f47272f5cf62 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.686751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.686751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.686751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.686751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.687569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:31.687674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:31.688151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.689827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.696254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 505/1023] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:31.702130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.709944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.710687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.711134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.711468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.712318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.714337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.785433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 519/1024] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:31 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:31.838458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c17e99-e608-46ed-b9ef-0df0e412adc8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.850738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:31.885318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.887685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.888170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.888596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.889604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] RBAC: Adding query filter params (type=image) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:31.890317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.892252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.899306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 506/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:31.908124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.061039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dad3f-bdc0-4911-a534-c1c01334c0ab None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.101831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.102453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.102756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.103036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.103795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] RBAC: Adding query filter params (interface=public, service_id=60c3d6a0f25d49bc814d586e6a1bf2f0, region_id=RegionOne) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:32.104093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.105465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7faba1-730e-44df-8af3-c096f0883059 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:32.111227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 520/1026] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:52:31 2022] GET /identity/v3/endpoints?service_id=60c3d6a0f25d49bc814d586e6a1bf2f0&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:32.118118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.231003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f4d30-822a-48d6-b39e-deaf57d7fc81 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.247376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970956-8694-445d-a648-1b6aa6da87bf None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.247848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970956-8694-445d-a648-1b6aa6da87bf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.248362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970956-8694-445d-a648-1b6aa6da87bf None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.251570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 521/1027] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:32.256612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.256891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.257166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.275701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.276384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.276607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.276883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.277535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.280739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:32.280866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:32.280953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:32.287214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 507/1028] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:32.321992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:32.380053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 522/1029] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:32.403263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.457543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:32.532509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec84e0-adea-4a9b-8ddd-e7054ed9366e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.567805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.568706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.569173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.569598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.580303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:32.586472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:32.587694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:32.588794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:32.590987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 508/1030] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:32.597901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.708423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41779a-6b39-45f5-aa11-2388de575bce None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.742790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.743410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.743686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.743958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.744671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:32.744971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.746334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:32.754618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 523/1031] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:32.760193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.860401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:32.867417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bf40-6995-4727-ad36-07a05a77c2b2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.902992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.903967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.904261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.904535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.915009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.921575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:32.931509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:32.932479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:32.933437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:32.933437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:32.933437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:32.933437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:32.934785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 509/1032] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:32.938625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.968571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.039854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458acf68-668c-461f-bac0-dc57887f572e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.073740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.074357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.074635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.074936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.075624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:33.075925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.077289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.090116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 524/1033] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:33.095607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.198171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b944487-57cd-4dc4-ab67-a8e49bbbd018 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.231990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.232626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.232906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.233179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.241074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.242517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:33.254155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:33.255358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:33.256369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:33.259036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 510/1034] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:52:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:33.261201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.348564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.360661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0551f-6baf-4451-86a6-10a8b23f30e7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.394432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.395262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.395547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.395823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.396616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:33.396920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.398343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.416308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 525/1035] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:52:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:33.422274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.435072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.526614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f114e-eafe-4945-92a9-46c60b8b82bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.560636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.561248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.561528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.561799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.630210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.631697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.641409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.743707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 511/1036] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:33.745275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.845382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ee29f-7a2a-4caa-8cee-10f02b9962d5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.885387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.886039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.886326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.886599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.897972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.899461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.906447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-575ce69a-71a2-4d6d-8236-c3d5ca095561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:33.915480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:33.916423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:33.922351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:33.922351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:33.922351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:33.922351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:33.922351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 526/1037] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:33.924386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.030132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d32c4-2ac2-4147-b09b-1ab5c609efc2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.058345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eea-59b8-4d7d-8db2-b1a62bbd97d9 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.058631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eea-59b8-4d7d-8db2-b1a62bbd97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.058959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eea-59b8-4d7d-8db2-b1a62bbd97d9 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.060394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 527/1038] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:34.065349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.066244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.066739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.067864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.068887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.069424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.069714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.070759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:34.071072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.072442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.084618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 512/1039] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:34.087273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:34.088536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.090268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.163559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 528/1040] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:34.188352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.213672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c86d8e-ae8d-49f3-96a1-b1cd10e2f0a3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.248855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.249498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.249776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.250046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.257478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.258979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:34.270313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:34.271489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:34.272892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 513/1041] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:34.277044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.296633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66623-09f0-491f-bad7-9ffbce8660e2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.305323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.326545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.334526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.335422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.335850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.336319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.338485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.340208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078030f-90a4-432b-ab16-bf204f348d60 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.342191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 529/1042] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:34.347216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcc63-4c3c-4e68-aa5d-9e2f57f453e1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.347216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcc63-4c3c-4e68-aa5d-9e2f57f453e1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.347216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcc63-4c3c-4e68-aa5d-9e2f57f453e1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.347216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 530/1043] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:34.348427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcc63-4c3c-4e68-aa5d-9e2f57f453e1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.383984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0461f-7535-4cf6-ab9b-2a6d3c411cff None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.418657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.419229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.419512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.419789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.420532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:34.420840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.422278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdb9c-6bff-465d-bf43-ea6acb3f3d09 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.434918 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 514/1044] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:34.436139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.436425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.436700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.448734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcc63-4c3c-4e68-aa5d-9e2f57f453e1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.453757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:34.454966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.481792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.482401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.482673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.482973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.483637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.485047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.522288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 515/1045] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:34.523150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.542879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.594745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 531/1046] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:34.594745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.629869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ef35-e6a8-4a57-a6f1-93f31eb87e90 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.645298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.671975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.672515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.672795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.673069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.673866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] RBAC: Adding query filter params (role.id=175a15a10f0d440ab08c32f70c2fa388, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:34.674174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.676282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.694760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 516/1047] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=175a15a10f0d440ab08c32f70c2fa388 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:34.713113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67235-ce69-47b7-97ba-884971408810 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.756249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.757174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.757639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.757912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] PATH_INFO: `/v3/services/image` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.758561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.760002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:34.770412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:34.771834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:34.772858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 532/1048] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:34.779160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.876127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.894352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd51c-93fe-46f1-9b1c-7ddea3d17c53 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.929250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.929784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.930060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.930339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.931040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] RBAC: Adding query filter params (name=image) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:34.931341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.932704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.942209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 517/1049] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:34.943778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.046634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321ef0-9f9b-4ee4-aa25-a08f77273b37 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.062464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:35.079906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.080524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.080799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.081672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.082420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] RBAC: Adding query filter params (type=image) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:35.082846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.084197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89caf-5bce-4a3b-9a29-03f7c6f98c7c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.093607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 533/1050] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:35.095188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.203654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0d3ca-2436-46a1-b1ae-f21b2250f398 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.238069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.238687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.239007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.239284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.239998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.241381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893ff3-a74f-4b9c-81fe-e0982c23bbcd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.322749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 518/1051] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:36.668988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2e17-7a0d-4c44-8e4d-ef45df9ec6eb None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.669545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2e17-7a0d-4c44-8e4d-ef45df9ec6eb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.669545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2e17-7a0d-4c44-8e4d-ef45df9ec6eb None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.671075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 534/1052] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:36.676214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.676638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.676807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.683232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:36.698157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:36.698157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:36.705787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf3e2-f6b9-413c-8119-e68d61a282d3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.705787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf3e2-f6b9-413c-8119-e68d61a282d3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.705787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf3e2-f6b9-413c-8119-e68d61a282d3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.705787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 535/1053] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:36.710928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.711213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.711493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.729472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:36.730655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:36.777818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 519/1054] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:36.801134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.810539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 536/1055] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:36.833916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.911350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc3bb1-92ac-4865-b5d2-06df46e5ec75 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.934513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83552-87c6-408c-baa7-10995cebbaee None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.940925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:36.946379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:36.950754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.952551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.952551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.952551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.963187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:36.968170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:36.969119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:36.969997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 520/1056] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:36.974349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.975001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.980505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.980505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.980677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.986753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:36.992730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:36.993695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:36.994582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 537/1057] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:36.999815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.080540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a380-79fc-4538-8925-9c691b1211b4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.113126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7a9a-59de-4e6b-8e7c-f81a6e973822 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.117571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.118195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.118473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.118791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.119510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:37.119814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.121193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.130057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 521/1058] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:37.135669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.152867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.153969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.154792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.157577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.157577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:37.157577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.158857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.169561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 538/1059] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:37.175706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.187606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.208328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.239402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8ab7-9ac9-4802-ad51-b5e8cbbef5f4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.277689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.278335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.278467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a570-b084-455b-9e68-353f285f3323 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.278646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.278897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] PATH_INFO: `/v3/users/8090c49718dc468a9330dca90408bfaf` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.294061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] RBAC: Authorizing `identity:get_user(user_id=8090c49718dc468a9330dca90408bfaf)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.295789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.297630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 522/1060] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/users/8090c49718dc468a9330dca90408bfaf => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:37.303941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.312832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.313482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.313766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.314054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.325487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.326960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-de66dd0d-df6a-4285-89c0-ce66bd62cf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:37.341419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:37.342582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:37.343768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:37.343768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:37.343768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:37.343768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:37.347365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 539/1061] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:37.348603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41247b5-ea3d-4d89-947c-e1a784a68c59 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.348884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41247b5-ea3d-4d89-947c-e1a784a68c59 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.349157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41247b5-ea3d-4d89-947c-e1a784a68c59 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.350439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 540/1062] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:37.351768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41247b5-ea3d-4d89-947c-e1a784a68c59 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.407143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895bde-026a-409d-9866-e4eb6962fb0b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.416860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.435941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.442385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.442959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.443252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.443523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.452206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41247b5-ea3d-4d89-947c-e1a784a68c59 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.485941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.486585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.486902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.487179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.488471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:37.488769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.490267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406697-18bc-4f15-97fb-ad48508fe087 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.501352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 541/1063] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:37.502530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.502918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.503197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.515578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.517028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.520408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:37.521590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:37.586194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 542/1064] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:37.587256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.622862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 523/1065] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:37.622862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.629079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.668239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.694612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc16e71-b6b6-4131-bbe5-36b87a86255f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.723571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50f520-81ea-4fce-98ad-02e566c88c9f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.729684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.730326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.730608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.730907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.738432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.739910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:37.751278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:37.752527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 543/1066] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:37.753903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.760471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.761084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.761364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.761635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.827726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.829179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.839370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.858641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78837-2677-4ebd-9572-9204919e1830 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.891670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.892301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.892573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.892842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.894505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.895950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.897603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 544/1067] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:37.898355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.901067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:37.929090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 524/1068] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:37.930211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.001240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c245-50cf-4fb5-bdac-a95909f3fa35 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.026691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c815-f5d4-4caf-b5df-466e4b4a5dc8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.033706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.035021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.035349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.035621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.036407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:38.036690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.036841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.038110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.054922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 545/1069] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:38.055775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.062261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.063102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.063439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.063878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.064934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8d0497b98bc34e52886892a58af61532, user.id=8090c49718dc468a9330dca90408bfaf) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:38.065246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.067339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.072889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 525/1070] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/role_assignments?user.id=8090c49718dc468a9330dca90408bfaf&scope.project.id=8d0497b98bc34e52886892a58af61532&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:38.073689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.136216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.180834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90dc61-37ca-4f1a-ae11-81fbd071e90a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.194798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdbe94-2ca9-4558-9298-a69e058acd7c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.221967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.222583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.222907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.223229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.235038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.236860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.238113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.238950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.239176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.239456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.249880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.251417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:38.255286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:38.256189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:38.257106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:38.257106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:38.257106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:38.257106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:38.257106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 546/1071] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:38.262276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:38.273168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:38.274168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:38.275534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:38.275534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:38.275534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:38.275534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:38.275534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 526/1072] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:38.279854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.308275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.366305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a02b-7428-4815-ab45-e79875e4dc04 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.380017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.392560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ad24-a02c-494a-8e19-9c36ae98d825 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.401090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.401713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.402047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.402328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.403070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:38.403373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.404742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.418997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 547/1073] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:38.440255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.441908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.442387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.442868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.443771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:38.444266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.445946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.465245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 527/1074] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:38.466233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.579335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55355-9bf7-4eda-b432-59a6dadf3372 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.614688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.615352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.615628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.615898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.622787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.624220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:38.636687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:38.637629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:38.638581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 548/1075] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:38.643876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.732431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.748390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324ca43-9719-4dcf-842a-786c36aba527 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.782794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.783418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.783698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.783973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.784769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:38.785074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.786514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b9e63-7dde-49f9-914d-b46b4e078ad4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:38.798133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 528/1076] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:38.804945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:38.835646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:38.902543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3e9-fc5e-4e1b-979b-f9a86782d47c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:38.936674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:38.937328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.937610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.937889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/175a15a10f0d440ab08c32f70c2fa388` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.940064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=1035c2a2b6b8440a9d975751de4724da, role_id=175a15a10f0d440ab08c32f70c2fa388)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:38.941682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd38086-0998-49f5-b8fd-54479ade0610 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:39.036744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 549/1077] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:38 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/1035c2a2b6b8440a9d975751de4724da/roles/175a15a10f0d440ab08c32f70c2fa388 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:40.085090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145fa-4ac8-4ebc-9fe9-7bfb5bb22043 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.085670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145fa-4ac8-4ebc-9fe9-7bfb5bb22043 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.085670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145fa-4ac8-4ebc-9fe9-7bfb5bb22043 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.087082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 529/1078] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:40.094461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.094461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.094461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.111517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:40.113297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:40.180925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 550/1079] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:40.203891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561145fa-4ac8-4ebc-9fe9-7bfb5bb22043 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:40.303885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561145fa-4ac8-4ebc-9fe9-7bfb5bb22043 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.337029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.337594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.337874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.338147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.349380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:40.354177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:40.355171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:40.356040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 530/1080] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:40.361320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:40.385209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.460616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15ef23-336c-43ed-bc3d-3edd42a4a011 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.493839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.494452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.494754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.495034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.495742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:40.496044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:40.497405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:40.505843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 551/1081] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:40.511506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:40.515298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.613355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2030f1-2836-46c5-b150-6f6030e07c4e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.646179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.646857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.647137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.647408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] PATH_INFO: `/v3/users/8090c49718dc468a9330dca90408bfaf` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.648566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8090c49718dc468a9330dca90408bfaf)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:40.650035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:40.651667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 531/1082] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:40 2022] GET /identity/v3/users/8090c49718dc468a9330dca90408bfaf => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:40.657377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:40.742880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.757765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e13ab8-6930-4501-b627-9d2263f47576 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.791904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.792797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.793077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.793353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.794503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:40.795957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f371858-5a3c-4b7f-8ea9-fd54f9b72c2d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:40.797763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 552/1083] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:40 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:40.804217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:40.873431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:40.904874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a991d9e-3f13-43b3-924a-34b63ab0e9e3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:40.938363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:40.939056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.939339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:40.939612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532/users/8090c49718dc468a9330dca90408bfaf/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:40.941666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8d0497b98bc34e52886892a58af61532, user_id=8090c49718dc468a9330dca90408bfaf, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:40.943135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:40.999530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee75627-5e11-4f0b-86b1-884d385529b5 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:40.999815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee75627-5e11-4f0b-86b1-884d385529b5 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.000085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee75627-5e11-4f0b-86b1-884d385529b5 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.001575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 553/1084] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:41.006204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.006481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.006776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.026142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:41.027357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:41.046425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 532/1085] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:40 2022] PUT /identity/v3/projects/8d0497b98bc34e52886892a58af61532/users/8090c49718dc468a9330dca90408bfaf/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:41.109448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 554/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:41.133038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.238732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de519935-f01d-4ed1-be6f-fd039632afdd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.266826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:41.272330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.272988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.273285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.273551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.283763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:41.288764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:41.289720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:41.290610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 533/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:41.296222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.374312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:41.392293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569970dd-77bc-4507-ad79-30cf7047e93e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.425853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.426467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.426774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.427049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.427755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:41.428061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:41.429416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:41.437491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 555/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:41.444109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.541486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4782a3c-94a5-4322-b44b-9960edbeef4d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.575422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.576060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.576343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.576621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.587232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:41.588700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:41.602752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:41.603696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:41.604605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:41.604605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:41.604605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:41.604605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:41.604605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 534/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:41.609605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.709408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3bb4a-e872-48a5-aea4-b7f2ca027056 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.742749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.743365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.743647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.743923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.744610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:41.744915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:41.746271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:41.758486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 556/1090] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:41.764079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.810128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:41.873733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562f2a-06b0-4285-8308-f07e4015df88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:41.907297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:41.907934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:41.908213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:41.908485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:41.916422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:41.918132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:52:41.929758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:41.930766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:52:41.931766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 535/1091] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:41.936792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:41.941309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.032915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a211c2c-f238-4874-a007-a03974388ef8 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:42.067782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:42.068398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.068679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.068957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.069752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:42.070059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:42.071523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:42.088420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 557/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Aug 3 12:52:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:42.094060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:42.196533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6cb3-6294-4633-a84a-909d02dd36c5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:42.198831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.230329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:42.230991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.231267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.231538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.298000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:42.299475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:42.395312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 536/1093] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:42.401157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:42.461542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.500261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263084-8aeb-4027-9cfa-3e803e206914 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:42.534136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:42.535472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.535755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.536033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.547906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:42.549392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:52:42.571603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:42.572581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:42.574039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:52:42.574039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:52:42.574039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:52:42.574039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:42.574039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 558/1094] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:42.578418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:42.582103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.677541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7e35f-8ee3-413d-8e45-b6529db14e52 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:42.714847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:42.715469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.715749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.716019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.716699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:42.717001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:42.718367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:42.729738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 537/1095] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:42.735373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:42.838386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3a356-6698-4366-915d-7e5e797fa252 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:42.851325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.870270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:42.870980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:42.871257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:42.871528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:42.878508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:42.880677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-b3971028-f5a4-49bc-8841-d6079aa03505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:52:42.891831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:42.892944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:42.894697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 559/1096] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:52:42.899386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:42.962022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:42.999530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78136cf-f341-4e0f-b7d8-fcf0e2ab3e76 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.030080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b269f0-14a6-4546-8ba0-e07809a5b105 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.030360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b269f0-14a6-4546-8ba0-e07809a5b105 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.030633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b269f0-14a6-4546-8ba0-e07809a5b105 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.032069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 560/1097] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:43.033083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.033693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.033971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.034277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.035059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:43.035364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.036797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.037104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.037386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.037652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.049353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 538/1098] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:43.055863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.056102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:43.057276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:43.122928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 561/1099] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:43.146337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.154649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eedb8-afba-419b-9a96-78b22364621e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.179293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.189925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.191311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.191595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.191876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.192661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] RBAC: Adding query filter params (role.id=175a15a10f0d440ab08c32f70c2fa388, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=1035c2a2b6b8440a9d975751de4724da) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:43.192967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.194435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.200320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 539/1100] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/role_assignments?user.id=1035c2a2b6b8440a9d975751de4724da&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=175a15a10f0d440ab08c32f70c2fa388 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:43.247193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bcf5-33ed-4a0e-8d84-1a334e8c0d98 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.249792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.284622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.285317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.285588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.285859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.297270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:52:43.302699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:52:43.303892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:52:43.304784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 562/1101] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:52:43.310109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.415799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930789-a938-4202-98e6-17ec710e2b8e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.451680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.452300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.452581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.452856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.453561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:43.453865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.455276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.463708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 540/1102] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:43.469632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.575768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7ba3-aa0f-47df-89f8-2ba376fb061b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.609370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.609999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.610272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.610542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] PATH_INFO: `/v3/users/8090c49718dc468a9330dca90408bfaf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.611720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] RBAC: Authorizing `identity:get_user(user_id=8090c49718dc468a9330dca90408bfaf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.613902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.615895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 563/1103] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/users/8090c49718dc468a9330dca90408bfaf => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:43.621308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.674041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.727995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249efe-ef53-4317-a60e-9c6ccad0cf5a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:43.765114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:43.765736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:43.766015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:43.766290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:43.837341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:43.839074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:43.887047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:43.942250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 541/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:43.948294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:43.981164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:44.050068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6161e04-3478-4a52-b134-c916391e7e2a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:44.083126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:44.083757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:44.084032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:44.084303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:44.085424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:44.086875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806edeb9-dfc2-43cf-9fb9-e57628b6bc2a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:44.088535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 564/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:43 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:44.094612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:44.192524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9270cfa-e0c9-4619-af09-f1c6db0fc394 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:44.225791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:44.226396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:44.226677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:44.226979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:44.227754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8d0497b98bc34e52886892a58af61532, user.id=8090c49718dc468a9330dca90408bfaf) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:44.228059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:44.229477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733afae-b4ad-4f23-b95d-dbd8eccc6b03 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:44.235076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 542/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:44 2022] GET /identity/v3/role_assignments?user.id=8090c49718dc468a9330dca90408bfaf&scope.project.id=8d0497b98bc34e52886892a58af61532&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:46.240553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429443-15f6-4c01-b7cf-ab306221cacf None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:46.241171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429443-15f6-4c01-b7cf-ab306221cacf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:46.241171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429443-15f6-4c01-b7cf-ab306221cacf None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:46.242503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 565/1107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:46.247619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:46.248048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:46.248168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:46.266630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:46.267843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:46.276912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:46.332887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 543/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:46.356473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a429443-15f6-4c01-b7cf-ab306221cacf None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:46.452069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:46.455625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a429443-15f6-4c01-b7cf-ab306221cacf None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:46.488826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:46.489441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:46.489724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:46.489993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:46.491260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:46.492594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8542266-d380-40f3-bab4-355b9ad5576b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:46.494159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 566/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:46.499768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:46.595955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ac921-c016-423b-8140-68fac4dec320 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:46.630263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:46.630919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:46.631202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:46.631476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:46.632158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:46.633591 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0612c3-08e8-4ccf-afe9-dc24bbe739aa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:46.719992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:46.725463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 544/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:52:46 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:48.744429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea80d-0ef2-4d41-8ba4-e6df2153da6c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.744900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea80d-0ef2-4d41-8ba4-e6df2153da6c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.744990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea80d-0ef2-4d41-8ba4-e6df2153da6c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:48.746369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 567/1111] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:48.751561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.751970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.752106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:48.771032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:48.772211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:48.837188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 545/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:48.860032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea80d-0ef2-4d41-8ba4-e6df2153da6c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:48.958403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea80d-0ef2-4d41-8ba4-e6df2153da6c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:48.991796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:48.992414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:48.992693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:48.992965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] PATH_INFO: `/v3/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:48.994403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] RBAC: Authorizing `identity:get_role(role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:48.995797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:48.997124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 568/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:48 2022] GET /identity/v3/roles/00224db748344c70b18c5c283bc0d81d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:49.003591 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:49.099585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d2777-c8df-4ad5-af88-78104c1ffb1e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:49.127366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.133692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:49.134323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:49.134602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:49.134904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] PATH_INFO: `/v3/users/3fef2e5555864b0a825d298cd5b7c7cf` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.147791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] RBAC: Authorizing `identity:get_user(user_id=3fef2e5555864b0a825d298cd5b7c7cf)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:49.149220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:49.150836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 546/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:49 2022] GET /identity/v3/users/3fef2e5555864b0a825d298cd5b7c7cf => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:49.156475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:49.191773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.254999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67589-5fa7-415a-948a-ace4c75c0f14 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:49.287695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:49.288301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:49.288579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:49.288855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.355309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:49.356754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:49.389284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.451595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 569/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:49.457292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:49.554879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd6185-03fb-4f1d-8ffd-b984a7413f7d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:49.587501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:49.588122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:49.588400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:49.588670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.589802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:49.591261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597a7cf-783d-46e8-ade6-84095f696a21 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:49.592886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 547/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:49 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:49.599426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:49.694489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7cd10-ad30-4c14-bc22-214a5ff3f563 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:49.727719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:49.728319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:49.728593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:49.728861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:49.729629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=8d0497b98bc34e52886892a58af61532, user.id=3fef2e5555864b0a825d298cd5b7c7cf) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:49.729929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:49.731364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de26a-60f3-402f-8b64-6606033397e5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:49.734046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.736818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 570/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:49 2022] GET /identity/v3/role_assignments?user.id=3fef2e5555864b0a825d298cd5b7c7cf&scope.project.id=8d0497b98bc34e52886892a58af61532&role.id=00224db748344c70b18c5c283bc0d81d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:51.693789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad61b-a32e-4e1e-83ab-3f813ea068f4 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:51.694362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad61b-a32e-4e1e-83ab-3f813ea068f4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:51.694362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ad61b-a32e-4e1e-83ab-3f813ea068f4 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:51.695718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 548/1118] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:51.700839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:51.701229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:51.701380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:51.720375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:51.721541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:51.785186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 571/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:51.807566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad61b-a32e-4e1e-83ab-3f813ea068f4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:51.863870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:51.907322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ad61b-a32e-4e1e-83ab-3f813ea068f4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:51.940931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:51.941552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:51.941830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:51.942101 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] PATH_INFO: `/v3/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:51.943566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] RBAC: Authorizing `identity:get_role(role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:51.944978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:51.946255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 549/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:51 2022] GET /identity/v3/roles/00224db748344c70b18c5c283bc0d81d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:51.952116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:52.046570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c5cc-45bb-4f83-9f58-59e516e494dd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:52.074731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:52.080347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:52.083481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:52.083481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:52.083481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] PATH_INFO: `/v3/users/3fef2e5555864b0a825d298cd5b7c7cf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:52.083481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] RBAC: Authorizing `identity:get_user(user_id=3fef2e5555864b0a825d298cd5b7c7cf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:52.084357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:52.085941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 572/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:51 2022] GET /identity/v3/users/3fef2e5555864b0a825d298cd5b7c7cf => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:52.091594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:52.189508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60969-0d92-4dde-aa74-0ea7205a1e6e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:52.212959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:52.223428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:52.224059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:52.224345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:52.224622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:52.225771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:52.227250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f01298-ff69-46b9-b41b-4c8af403d3d1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:52.228903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 550/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:52 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:52.234853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:52.329896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b8a0a-014c-48f4-a6c2-00994cbffced None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:52.363074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:52.363724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:52.364000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:52.364271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532/users/3fef2e5555864b0a825d298cd5b7c7cf/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:52.366435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d0497b98bc34e52886892a58af61532, user_id=3fef2e5555864b0a825d298cd5b7c7cf, role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:52.367861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915c0e-0eaa-47f3-b357-8ec2c5383a33 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:52.416401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 573/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:52:52 2022] PUT /identity/v3/projects/8d0497b98bc34e52886892a58af61532/users/3fef2e5555864b0a825d298cd5b7c7cf/roles/00224db748344c70b18c5c283bc0d81d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:54.364803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddce2-8a8e-4e41-b5ed-18bff55f6d06 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:54.365376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddce2-8a8e-4e41-b5ed-18bff55f6d06 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:54.365376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeddce2-8a8e-4e41-b5ed-18bff55f6d06 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:54.366702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 551/1124] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:54.371687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:54.372086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:54.372229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:54.389635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:54.390825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:54.441431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:54.454109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 574/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:54.477920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeddce2-8a8e-4e41-b5ed-18bff55f6d06 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:54.576939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeddce2-8a8e-4e41-b5ed-18bff55f6d06 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:54.609841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:54.610461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:54.610760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:54.611037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] PATH_INFO: `/v3/roles/00224db748344c70b18c5c283bc0d81d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:54.612485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] RBAC: Authorizing `identity:get_role(role_id=00224db748344c70b18c5c283bc0d81d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:54.613836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:54.615241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 552/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:54 2022] GET /identity/v3/roles/00224db748344c70b18c5c283bc0d81d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:54.621144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:54.718536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b07d5-a036-4314-9b51-11de098f7c1d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:54.750932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:54.751560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:54.751836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:54.752107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] PATH_INFO: `/v3/users/3fef2e5555864b0a825d298cd5b7c7cf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:54.754321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] RBAC: Authorizing `identity:get_user(user_id=3fef2e5555864b0a825d298cd5b7c7cf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:54.755777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:54.757375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 575/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:52:54 2022] GET /identity/v3/users/3fef2e5555864b0a825d298cd5b7c7cf => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:54.763192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:54.821083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:54.860888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550c96-c243-4bb1-95d4-fe3e3dbd435b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:54.894816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:54.895353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:54.895632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:54.895900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:54.961718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:54.963181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:55.018115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:55.058023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 553/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:52:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:52:55.063860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:55.117609 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:55.158861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1a138-b1a2-4000-b85a-b590a2660045 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:55.192624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:55.193250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:55.193528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:55.193802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] PATH_INFO: `/v3/projects/8d0497b98bc34e52886892a58af61532` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:55.194963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] RBAC: Authorizing `identity:get_project(project_id=8d0497b98bc34e52886892a58af61532)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:55.196391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494793a-c36c-4d75-ad05-bf56bd26c117 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:55.198038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 576/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:52:55 2022] GET /identity/v3/projects/8d0497b98bc34e52886892a58af61532 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:55.204133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:55.299532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1dc6-0e9c-4833-a4a0-a5624475c8c4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:55.333055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:55.333656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:55.333938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:55.334214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:55.335018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] RBAC: Adding query filter params (role.id=00224db748344c70b18c5c283bc0d81d, scope.project.id=8d0497b98bc34e52886892a58af61532, user.id=3fef2e5555864b0a825d298cd5b7c7cf) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:55.335326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:55.336910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71ed5-aef3-4256-93d2-63955153cccd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:55.342522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 554/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:52:55 2022] GET /identity/v3/role_assignments?user.id=3fef2e5555864b0a825d298cd5b7c7cf&scope.project.id=8d0497b98bc34e52886892a58af61532&role.id=00224db748344c70b18c5c283bc0d81d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:57.328971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb3b-66fb-4eb1-ac2b-52955526b16e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:57.329535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb3b-66fb-4eb1-ac2b-52955526b16e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:57.329535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aeb3b-66fb-4eb1-ac2b-52955526b16e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:57.331497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 577/1131] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:57.336454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:57.336880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:57.336993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:57.355777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:57.356945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:57.373891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:57.423093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 555/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:52:57.445695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aeb3b-66fb-4eb1-ac2b-52955526b16e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:57.544656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aeb3b-66fb-4eb1-ac2b-52955526b16e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:57.566577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:57.576657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:57.577276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:57.577552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:57.577823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:57.579032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:57.580390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb57ed-42d2-4828-9f7f-620d4b1052ef None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:57.582479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 578/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:57.588411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:57.685407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8d8e1-c3b7-448d-8b07-7810dfa6e29d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:57.722617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:57.723261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:57.723544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:57.723817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:57.724488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:57.726074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2e267-5a69-4d3c-9e45-38722daf48e0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:57.812166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 556/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:52:57 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:59.823530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b31-94a8-42c8-918d-aa041991551c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:59.824036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b31-94a8-42c8-918d-aa041991551c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:59.824127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08b31-94a8-42c8-918d-aa041991551c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:59.825436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 579/1135] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:59.830635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:59.831640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:59.832187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:59.844949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:59.850936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:59.852113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:59.917827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 557/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:52:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:52:59.942240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08b31-94a8-42c8-918d-aa041991551c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:00.038347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08b31-94a8-42c8-918d-aa041991551c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:00.070809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:00.071425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:00.071704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:00.071975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:00.073106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:00.074513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94611f83-f964-47a8-989e-ffd39843aaf2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:00.076122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 580/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:53:00.082366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:00.178429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdced9-9689-4079-ba30-bf258e6aeaa6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:00.213277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:00.213880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:00.214158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:00.214432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:00.215139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:00.235006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d00210-67a1-4fab-ba19-ed0f9a9ee125 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:00.235006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:00.331857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 558/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:53:00 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:02.392152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ca34-d356-4f22-8e1f-b9ddc31b3892 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:02.392691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ca34-d356-4f22-8e1f-b9ddc31b3892 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:02.392691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ca34-d356-4f22-8e1f-b9ddc31b3892 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:02.394172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 581/1139] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:02.399315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:02.399714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:02.399861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:02.418767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:02.419940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:02.485341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 559/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:02.509152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ca34-d356-4f22-8e1f-b9ddc31b3892 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:02.568716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:02.608844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ca34-d356-4f22-8e1f-b9ddc31b3892 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:02.640936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:02.641561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:02.641841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:02.642114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:02.652400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:02.657237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:02.658439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:02.660530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 582/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:02.664944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:02.769787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444c87-a414-4096-9cbd-c227870a6193 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:02.791983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:02.803535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:02.804123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:02.804404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:02.804678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:02.805381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:02.805682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:02.807083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:02.814883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 560/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:02.820655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:02.918355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff856a-ffe7-49ca-84b4-181898f997ca None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:02.937602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:02.951581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:02.952204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:02.952485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:02.952764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] PATH_INFO: `/v3/users/1b165ef24cac4b55a081d859f3d9fbf7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:02.966729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] RBAC: Authorizing `identity:get_user(user_id=1b165ef24cac4b55a081d859f3d9fbf7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:02.968169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:02.969790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 583/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:02 2022] GET /identity/v3/users/1b165ef24cac4b55a081d859f3d9fbf7 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:02.975637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:03.075077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4ee1-299f-4a9e-8bb0-eae519960bdd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:03.107385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:03.107981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:03.108257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:03.108532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:03.158259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:03.173415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:03.174848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:03.271285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 561/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:53:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:53:03.277326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:03.373936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d57e2-48f8-4327-81a0-3b56b6b1094f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:03.407068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:03.407684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:03.407958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:03.408227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] PATH_INFO: `/v3/projects/7c94af461aa144809bcd77dbd94449a9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:03.409822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] RBAC: Authorizing `identity:get_project(project_id=7c94af461aa144809bcd77dbd94449a9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:03.411275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c68e0-90eb-4f5e-a514-292f3a0b6d79 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:03.412911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 584/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:03 2022] GET /identity/v3/projects/7c94af461aa144809bcd77dbd94449a9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:03.419278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:03.501047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:03.516319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fb13-221b-4155-9034-6f347d7f666b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:03.549271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:03.550411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:03.550684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:03.550985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:03.551761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=7c94af461aa144809bcd77dbd94449a9, user.id=1b165ef24cac4b55a081d859f3d9fbf7) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:03.552067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:03.553487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecd232-e30f-40b7-9c2b-4d2596cf2604 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:03.558932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 562/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:53:03 2022] GET /identity/v3/role_assignments?user.id=1b165ef24cac4b55a081d859f3d9fbf7&scope.project.id=7c94af461aa144809bcd77dbd94449a9&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:05.512040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f465-a488-4d55-ac45-74aa3e2ba123 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:05.512571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f465-a488-4d55-ac45-74aa3e2ba123 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:05.512693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f465-a488-4d55-ac45-74aa3e2ba123 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:05.513976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 585/1147] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:05.519006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:05.519422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:05.519558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:05.537185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:05.538363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:05.603315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 563/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:05.626014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717f465-a488-4d55-ac45-74aa3e2ba123 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:05.673415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:05.724953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717f465-a488-4d55-ac45-74aa3e2ba123 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:05.757979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:05.758604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:05.758910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:05.759180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:05.768947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:05.773712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:05.774858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:05.775990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 586/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:05.780879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:05.856530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:05.877691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17220c01-0aa5-4941-b645-bd1ba69a878f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:05.911510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:05.912109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:05.912389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:05.912662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:05.913364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:05.913692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:05.915083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:05.923146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 564/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:05.930046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.024383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662ccb-7ca2-4ed1-9eb2-9f4525c1b4d3 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.031172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.057722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.058336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.058610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.058911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] PATH_INFO: `/v3/users/1b165ef24cac4b55a081d859f3d9fbf7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.060042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] RBAC: Authorizing `identity:get_user(user_id=1b165ef24cac4b55a081d859f3d9fbf7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.061488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.063912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 587/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:05 2022] GET /identity/v3/users/1b165ef24cac4b55a081d859f3d9fbf7 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:06.069021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.166559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe46e39-0456-4660-bd29-40be3650f5d4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.200419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.201052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.201333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.201607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] PATH_INFO: `/v3/projects/7c94af461aa144809bcd77dbd94449a9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.202774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] RBAC: Authorizing `identity:get_project(project_id=7c94af461aa144809bcd77dbd94449a9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.204213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e8e55-770f-49c7-8a15-2aefc104d7ea None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.206095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 565/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:06 2022] GET /identity/v3/projects/7c94af461aa144809bcd77dbd94449a9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:06.212642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.309145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123874e-5fa7-47f2-a3f8-e6d36ac37a49 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.341764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.342411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.342691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.342996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] PATH_INFO: `/v3/projects/7c94af461aa144809bcd77dbd94449a9/users/1b165ef24cac4b55a081d859f3d9fbf7/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.344901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] RBAC: Authorizing `identity:create_grant(project_id=7c94af461aa144809bcd77dbd94449a9, user_id=1b165ef24cac4b55a081d859f3d9fbf7, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.346306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ea7d8-3a78-4b04-a458-c089c63bc25c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.434010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 588/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:53:06 2022] PUT /identity/v3/projects/7c94af461aa144809bcd77dbd94449a9/users/1b165ef24cac4b55a081d859f3d9fbf7/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:08.406338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394bda-598a-4b10-92a6-37fca746bf9d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:08.406899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394bda-598a-4b10-92a6-37fca746bf9d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:08.406899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394bda-598a-4b10-92a6-37fca746bf9d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:08.408252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 566/1154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:08.414117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:08.414553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:08.414672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:08.433373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:08.434561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:08.460064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:08.499134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 589/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:08.522910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394bda-598a-4b10-92a6-37fca746bf9d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:08.534100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:08.622341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394bda-598a-4b10-92a6-37fca746bf9d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:08.654629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:08.655278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:08.655557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:08.655829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:08.667813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:08.672585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:08.673718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:53:08.674829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 567/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:08.680102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:08.775099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09c9f6-7e4e-42aa-a4f8-acac5974de03 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:08.807575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:08.808178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:08.808454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:08.808721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:08.809419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:08.809722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:08.811095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:08.818893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 590/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:08.824666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:08.889815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:08.922574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b185c5-3a27-4327-beb9-ccd92aeb2971 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:08.956556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:08.957193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:08.957476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:08.957749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] PATH_INFO: `/v3/users/1b165ef24cac4b55a081d859f3d9fbf7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:08.958930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] RBAC: Authorizing `identity:get_user(user_id=1b165ef24cac4b55a081d859f3d9fbf7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:08.960358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:08.961937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 568/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:08 2022] GET /identity/v3/users/1b165ef24cac4b55a081d859f3d9fbf7 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:08.967616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:08.994408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:09.064568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3700d2-579d-40b6-83f2-8f4d793f599d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:09.096926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:09.097521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.097797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.098067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.161921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:09.163380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:09.187907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:09.258359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 591/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:53:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:53:09.264313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:09.363716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8bbb7-c9d0-4812-9691-c43f28763ead None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:09.396611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:09.397235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.397514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.397790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] PATH_INFO: `/v3/projects/7c94af461aa144809bcd77dbd94449a9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.398953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] RBAC: Authorizing `identity:get_project(project_id=7c94af461aa144809bcd77dbd94449a9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:09.400370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75c0ba-7ee1-486a-a5dc-a7cb5488723f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:09.402015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 569/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:09 2022] GET /identity/v3/projects/7c94af461aa144809bcd77dbd94449a9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:09.408173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:09.502634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f7784-6ff1-447e-ad5f-006cb6b6784d None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:09.526997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:09.535676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:09.536274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:09.541546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:09.541546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:09.541546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=7c94af461aa144809bcd77dbd94449a9, user.id=1b165ef24cac4b55a081d859f3d9fbf7) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:09.541546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:09.541546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a022-2072-4ecc-afd1-8704f19b1443 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:09.545111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 592/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:53:09 2022] GET /identity/v3/role_assignments?user.id=1b165ef24cac4b55a081d859f3d9fbf7&scope.project.id=7c94af461aa144809bcd77dbd94449a9&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:11.545337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09619-d3c3-414d-8ac7-fd33caa844a5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.545871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09619-d3c3-414d-8ac7-fd33caa844a5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.545871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d09619-d3c3-414d-8ac7-fd33caa844a5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.547285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 570/1162] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:11.553046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.553423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.553605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.571850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:11.573035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.636930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 593/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:11.658671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d09619-d3c3-414d-8ac7-fd33caa844a5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.662529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:11.759130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d09619-d3c3-414d-8ac7-fd33caa844a5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.790424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.791059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.791337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.791606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.856945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.858317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.860825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:11.953295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 571/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:53:11.959918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:12.054260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbcc9-178e-4837-9067-0b781b833dd6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.072864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:12.085809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.086432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.098135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.098135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.098135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.098135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-0cd5ff8c-9402-48ee-a7d4-3087ce3010b5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:12.106262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:12.107589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:12.108576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 594/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:12.114106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:12.210310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db3e62-7d09-4eb0-b33a-256ad0782596 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.212643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:12.244531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.245139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.245420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.245696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.246378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:12.246685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.248124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4461d-4b48-4003-9eec-0f0b4396ab9f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.255392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 572/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Aug 3 12:53:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:14.249078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4bd0-eb01-4dbc-bddc-e483034da6d2 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.249611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4bd0-eb01-4dbc-bddc-e483034da6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.249611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e4bd0-eb01-4dbc-bddc-e483034da6d2 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.251028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 595/1167] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:14.256703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42e1c-dba5-4e67-b52a-e36a1d594231 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.257126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42e1c-dba5-4e67-b52a-e36a1d594231 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.257264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e42e1c-dba5-4e67-b52a-e36a1d594231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.276335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-63e42e1c-dba5-4e67-b52a-e36a1d594231 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:14.277521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63e42e1c-dba5-4e67-b52a-e36a1d594231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:14.342533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 573/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:14.364810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e4bd0-eb01-4dbc-bddc-e483034da6d2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:14.464111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e4bd0-eb01-4dbc-bddc-e483034da6d2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:14.496233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:14.496829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:14.497104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:14.497375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:14.498066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:14.499534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4ddc2-0516-49ab-b07e-1c01df4e13f9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:14.583729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 596/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Wed Aug 3 12:53:14 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:16.597180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae3e8-be5f-4089-b289-1930ffbfc0d2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.597716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae3e8-be5f-4089-b289-1930ffbfc0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.597836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dae3e8-be5f-4089-b289-1930ffbfc0d2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.599244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 574/1170] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:16.604467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.604868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.605019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.623137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:16.624313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:16.656439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:16.688000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 597/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:16.710882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae3e8-be5f-4089-b289-1930ffbfc0d2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.804699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:16.809248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dae3e8-be5f-4089-b289-1930ffbfc0d2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:16.842538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:16.843198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.843477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.843748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] PATH_INFO: `/v3/domains/c4e1b0c034d3487aa760e502973de027` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.854618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c4e1b0c034d3487aa760e502973de027)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:16.856034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8a533-375d-435a-95b8-1d21db0ad570 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:16.857626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 575/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Aug 3 12:53:16 2022] GET /identity/v3/domains/c4e1b0c034d3487aa760e502973de027 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:16.863597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.958023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec33cf2-05a5-4237-ab56-f40686fa6e0f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:16.990558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:16.991186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.991463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.991735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.992406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:16.993817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcaa8d-0ba8-4ab2-9c23-97a178ea387d None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.085383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 598/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:53:16 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:19.102560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf794-04e3-4ebc-9ef8-8361a9c0aa22 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.103107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf794-04e3-4ebc-9ef8-8361a9c0aa22 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.103202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf794-04e3-4ebc-9ef8-8361a9c0aa22 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.104500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 576/1174] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:19.109572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.109942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.110122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.128009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:19.129195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:19.145530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:19.193952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 599/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:19.218945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddf794-04e3-4ebc-9ef8-8361a9c0aa22 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:19.318404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddf794-04e3-4ebc-9ef8-8361a9c0aa22 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:19.351234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:19.351857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.352133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.352405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] PATH_INFO: `/v3/domains/c4e1b0c034d3487aa760e502973de027` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.353592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=c4e1b0c034d3487aa760e502973de027)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:19.354986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed1c9c-3305-421b-a972-97544a6ff0fe None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:19.356549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 577/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Aug 3 12:53:19 2022] GET /identity/v3/domains/c4e1b0c034d3487aa760e502973de027 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:19.362311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:19.458600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72daaec-3cc6-4862-b6e6-25c91bb3d1b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:19.490906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:19.491518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.491801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.492079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.492762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:19.494188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ce1cd-309e-4ee6-9304-f4395ba13456 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:19.571862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 600/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:53:19 2022] POST /identity/v3/users => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:21.606057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045e96-1611-4a8b-b9fa-4fe8d7483cdd None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:21.606694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045e96-1611-4a8b-b9fa-4fe8d7483cdd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:21.606694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045e96-1611-4a8b-b9fa-4fe8d7483cdd None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:21.607974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 578/1178] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:21.613310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:21.613701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:21.613863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:21.632200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:21.633387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:21.635317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:21.700716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 601/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:21.724394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045e96-1611-4a8b-b9fa-4fe8d7483cdd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:21.751810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:21.824109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045e96-1611-4a8b-b9fa-4fe8d7483cdd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:21.856468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:21.857033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:21.857311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:21.857584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:21.867851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:21.872625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:21.873828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:53:21.874866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 579/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:21.880283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:21.976258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f10bb-ced7-4d88-a583-029286f16ad0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:22.010027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:22.010734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:22.011022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:22.011296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:22.012011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:22.012314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:22.013665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:22.018467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:22.021845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 602/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:22.027636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:22.109713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:22.124278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f47a-66df-43c7-861b-c76a21840f5c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:22.157659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:22.161112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:22.161112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:22.161112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] PATH_INFO: `/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:22.172755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] RBAC: Authorizing `identity:get_user(user_id=f76591d2e2bb4f81adeb53d2d53eb0cc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:22.174209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:22.176457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 580/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:22 2022] GET /identity/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:22.182347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:22.337464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8ef2-c83b-4995-8ec2-8d48a50bf0e5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:22.369574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:22.370117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:22.370396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:22.370666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:22.432940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:22.435037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:22.436474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:22.529767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 603/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:53:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:53:22.536581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:22.633400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4cf99-9526-412c-afff-be75dc2fa187 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:22.665879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:22.666492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:22.666793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:22.667070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] PATH_INFO: `/v3/projects/b5bf058d59404893933b22d2f3e23393` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:22.668447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5bf058d59404893933b22d2f3e23393)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:22.669867 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f000cb-8400-43c8-9789-2b5c338fe6c8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:22.671504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 581/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:22 2022] GET /identity/v3/projects/b5bf058d59404893933b22d2f3e23393 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:22.678190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:22.771316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:22.774190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdbcfb-7ffb-4287-8406-c6fe701430d7 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:22.807223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:22.807827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:22.808105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:22.808376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:22.809153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=b5bf058d59404893933b22d2f3e23393, user.id=f76591d2e2bb4f81adeb53d2d53eb0cc) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:22.809460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:22.810911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d1adc-5e90-4137-a66b-5110f60b72ac None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:22.816661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 604/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:53:22 2022] GET /identity/v3/role_assignments?user.id=f76591d2e2bb4f81adeb53d2d53eb0cc&scope.project.id=b5bf058d59404893933b22d2f3e23393&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:24.752990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64d1b-d5ba-4255-b062-36624471cc6b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:24.754080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64d1b-d5ba-4255-b062-36624471cc6b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:24.754080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64d1b-d5ba-4255-b062-36624471cc6b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:24.755466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 582/1186] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:24.760923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:24.761406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:24.761889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:24.784549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:24.785994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:24.850209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 605/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:24.872192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64d1b-d5ba-4255-b062-36624471cc6b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:24.887495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:24.973595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64d1b-d5ba-4255-b062-36624471cc6b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:25.007000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:25.007621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:25.007901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:25.008171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:25.018028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:25.023599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:25.024731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:53:25.025649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 583/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:25.030641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:25.119373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:25.125703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3453d-cc9e-4efa-95bb-52b1fa901fce None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:25.158036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:25.159265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:25.162345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:25.162345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:25.162345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:25.162345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:25.162929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:25.171157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 606/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:25.177284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:25.246590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:25.276629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ed3ee-c63b-411c-862f-9eb5153b951e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:25.309735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:25.310366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:25.310646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:25.310945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] PATH_INFO: `/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:25.312085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] RBAC: Authorizing `identity:get_user(user_id=f76591d2e2bb4f81adeb53d2d53eb0cc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:25.313504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:25.315118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 584/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:25 2022] GET /identity/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:25.320881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:25.418829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1b9c-3467-4333-884b-d9e064bdb0aa None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:25.451034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:25.451656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:25.451935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:25.452209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] PATH_INFO: `/v3/projects/b5bf058d59404893933b22d2f3e23393` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:25.453349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] RBAC: Authorizing `identity:get_project(project_id=b5bf058d59404893933b22d2f3e23393)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:25.454785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0ad76-cd10-4279-9552-21d40cac5793 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:25.456437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 607/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:25 2022] GET /identity/v3/projects/b5bf058d59404893933b22d2f3e23393 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:25.462892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:25.557845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d8e67-03dd-45a0-8d77-d19ce3414c73 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:25.591262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:25.591906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:25.592183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:25.592457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] PATH_INFO: `/v3/projects/b5bf058d59404893933b22d2f3e23393/users/f76591d2e2bb4f81adeb53d2d53eb0cc/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:25.594354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] RBAC: Authorizing `identity:create_grant(project_id=b5bf058d59404893933b22d2f3e23393, user_id=f76591d2e2bb4f81adeb53d2d53eb0cc, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:25.595808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc3712-c138-4667-99e6-de2090e239cd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:25.675639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:25.680022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 585/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:53:25 2022] PUT /identity/v3/projects/b5bf058d59404893933b22d2f3e23393/users/f76591d2e2bb4f81adeb53d2d53eb0cc/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:27.623833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b88b-2118-4932-a485-960f96d8034f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:27.624389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b88b-2118-4932-a485-960f96d8034f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:27.624389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b88b-2118-4932-a485-960f96d8034f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:27.625744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 608/1193] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:27.631681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:27.632057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:27.632238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:27.650491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:27.651700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:27.716558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 586/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:53:27.739553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636b88b-2118-4932-a485-960f96d8034f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:27.764790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:27.838723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636b88b-2118-4932-a485-960f96d8034f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:27.870486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:27.871205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:27.871486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:27.871756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:27.882745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:53:27.887649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:53:27.888756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:53:27.889876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 609/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:53:27.895729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:27.991277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fd9fb-bb4e-493c-930c-11531d7edc21 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:28.019584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:28.025118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:28.025717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:28.025992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:28.026260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:28.026989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:28.030016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:28.030016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:28.036403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 587/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:28.042131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:28.123446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:28.139144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e6e06-1539-4b7e-9717-4a94a0de49cb None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:28.170829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:28.171451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:28.171729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:28.172003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] PATH_INFO: `/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:28.173145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] RBAC: Authorizing `identity:get_user(user_id=f76591d2e2bb4f81adeb53d2d53eb0cc)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:28.174623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:28.176780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 610/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Aug 3 12:53:28 2022] GET /identity/v3/users/f76591d2e2bb4f81adeb53d2d53eb0cc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:28.182504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:28.279824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a70c9-4f80-4078-85e8-babfb77b6671 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:28.312925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:28.313529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:28.313808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:28.314081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:28.370381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:28.380104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:28.381548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:28.476719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 588/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:53:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:53:28.482549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:28.577378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b143238-d137-4054-98ba-3b4f626a756f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:28.609047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:28.609667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:28.609944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:28.610215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] PATH_INFO: `/v3/projects/b5bf058d59404893933b22d2f3e23393` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:28.611360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] RBAC: Authorizing `identity:get_project(project_id=b5bf058d59404893933b22d2f3e23393)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:28.612798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a4a5-43d7-47e8-87f3-30a9d0313e59 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:28.614427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 611/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Aug 3 12:53:28 2022] GET /identity/v3/projects/b5bf058d59404893933b22d2f3e23393 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:28.620417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:28.712583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:28.720718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6880c3-5c09-46c3-bdcd-7ad1adf255e4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:28.754407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:28.754998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:28.755274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:28.755543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:28.756310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=b5bf058d59404893933b22d2f3e23393, user.id=f76591d2e2bb4f81adeb53d2d53eb0cc) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:28.756615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:28.758040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062aea6-4c0a-4cab-8a98-5fe032ae94da None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:28.763629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 589/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:53:28 2022] GET /identity/v3/role_assignments?user.id=f76591d2e2bb4f81adeb53d2d53eb0cc&scope.project.id=b5bf058d59404893933b22d2f3e23393&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:38.605092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:38.761039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=22 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:40.605176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dffc8-301e-461d-a1c8-d7aadb80814e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:40.605756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dffc8-301e-461d-a1c8-d7aadb80814e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:40.605756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dffc8-301e-461d-a1c8-d7aadb80814e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:40.607113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 612/1201] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:40.612263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:40.612700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:40.612801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:40.631193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:40.632381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:40.701070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 590/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:40.726065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dffc8-301e-461d-a1c8-d7aadb80814e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:40.826721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dffc8-301e-461d-a1c8-d7aadb80814e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:40.860587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:40.861162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:40.861444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:40.861716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:40.872394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:40.873867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:40.887605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:40.888670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:40.889808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:40.889808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:40.889808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:40.889808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:40.889808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 613/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:40.894739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:40.993721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c9199-14a5-48a0-bbc3-e97404b9127a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:41.022322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:41.028021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:41.028632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:41.028911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:41.029186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:41.029864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:41.030162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:41.031565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03c1ef-e846-4b4b-88d1-d027343d0163 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:41.043343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 591/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:41.049156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:41.102268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:41.147452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdeee-a256-4614-b73a-82195bcc40a6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:41.180046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:41.180646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:41.180924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:41.181199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:41.181916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:41.183408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10e8e7-767d-49d6-91e8-854de3757439 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:41.290872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 614/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Aug 3 12:54:41 2022] POST /identity/v3/users => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:43.326343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ff4c-9142-45e9-83ae-37f1d833805d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:43.326935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ff4c-9142-45e9-83ae-37f1d833805d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:43.326935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ff4c-9142-45e9-83ae-37f1d833805d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:43.328408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 592/1206] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:43.333528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:43.334159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:43.334159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:43.352563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:43.353748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:43.418939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 615/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:43.442920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ff4c-9142-45e9-83ae-37f1d833805d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:43.545904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ff4c-9142-45e9-83ae-37f1d833805d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:43.578862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:43.579437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:43.579714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:43.579985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:43.590510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:54:43.595323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:43.596483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:43.597438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 593/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:54:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:43.604709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:43.643018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:43.700021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747007c7-efe4-40d4-b921-cd83585b42d1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:43.733576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:43.734184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:43.734461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:43.734751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:43.735454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:43.735752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:43.737115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:43.744740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 616/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:54:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:43.750451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:43.800905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:43.850043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539294-a7f9-46fc-b0a3-8a9f4e9aadf6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:43.883452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:43.884088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:43.884368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:43.884640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:43.895121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:43.897160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:43.911094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:43.913107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:43.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:43.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:43.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:43.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:43.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 594/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:43.919055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.014407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:44.017253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4053-e0e8-48d7-a717-da8b6031778f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.049985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.050624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.050932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.051209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.051898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:44.052205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:44.054185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:44.065576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 617/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:44.071556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.170506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c9da-11c6-488f-8721-4f784bdcbfc7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.171986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:44.203647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.204278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.204560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.204832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.212260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:44.213700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:54:44.225273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:44.227515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:44.228789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 595/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:44.232324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.330096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb58280-3103-4b90-9b1d-f0f98ee5a34a None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.363361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.364010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.364305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.364585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.365986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:44.366289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:44.367761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:44.384348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 618/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:54:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:44.390208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.489553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8211e-d5bc-43b2-84b6-fe4331bb42b4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.523976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.524580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.524856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.525126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.554318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:44.590927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:44.592378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:44.690623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 596/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:54:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:54:44.697924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.716861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:44.795511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320bcb-3e4f-4cd5-af9e-e8cd06850214 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.828634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.829254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.829528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.829795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.839625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:44.841647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:44.855699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:44.856761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:44.857904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:44.857904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:44.857904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:44.857904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:44.857904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 619/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:44.862692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:44.923599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:44.962615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832b36-fc34-4216-991a-d432bf92868c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:44.996847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:44.997464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:44.997744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:44.998015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:44.998698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:44.999057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:45.000429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:45.012415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 597/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:45.018090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:45.086389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:45.115883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c421dec-0668-49f6-bf90-b6cab4bf2b2f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:45.148394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:45.149025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:45.149310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:45.149586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:45.156234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:45.157669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:54:45.170344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:45.171562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:45.172879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 620/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:45.177346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:45.276207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67edbff-12d3-42c1-b16a-52abfb8f9bb4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:45.298484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:45.309774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:45.310381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:45.310658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:45.310957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:45.311694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:45.311996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:45.313419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404dee-1856-4bf2-828c-5b2ae18c6e79 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:45.324907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 598/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:45.331399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:45.431969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06fbf-4eb7-4bfb-ad9d-62ec2d19a174 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:45.459926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:45.465571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:45.466218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:45.466502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:45.466801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:45.467584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=f523bf78506741138174ea01898f58df) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:45.467888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:45.469314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8272aa-ff56-49c2-8eff-2b08a92fc6b4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:45.475339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 621/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:54:45 2022] GET /identity/v3/role_assignments?user.id=f523bf78506741138174ea01898f58df&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:47.453499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6c91-ac1b-4017-8bee-1bdad3d37159 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:47.454029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6c91-ac1b-4017-8bee-1bdad3d37159 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:47.454159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6c91-ac1b-4017-8bee-1bdad3d37159 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:47.455476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 599/1220] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:47.461257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:47.461677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:47.461813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:47.480190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:47.481373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:47.546560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 622/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:47.569686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6c91-ac1b-4017-8bee-1bdad3d37159 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:47.669768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6c91-ac1b-4017-8bee-1bdad3d37159 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:47.703645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:47.704226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:47.704505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:47.704775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:47.715197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:54:47.719977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:47.721142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:47.722209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 600/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:54:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:47.727453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:47.824768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3dfc9-3e76-48c8-af12-bd0f8df9fb42 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:47.847371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:47.858053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:47.858640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:47.858948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:47.859222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:47.859929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:47.860230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:47.861584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:47.869951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 623/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:54:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:47.875823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:47.920553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:47.976836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e5de-1835-4da8-8c7d-938605748692 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.009887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.010516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.010824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.011101 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.021071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.023220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:48.039130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:48.040206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:48.048362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:48.048362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:48.048362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:48.048362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:48.048362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 601/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:48.048748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.147401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479173e9-9e48-47de-9760-bc41d45d0ee5 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.180225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.180836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.181175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.181456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.182195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:48.182501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.183914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.195506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 624/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:48.201224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.294986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:48.301473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ceb40-55a8-4e16-8b47-d4b34966a7d0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.334645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.335404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.335687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.335963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.343290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.344734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:54:48.357084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:48.358273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:48.359715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 602/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:48.364053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.409300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:48.459348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8928c-6511-41a4-8367-e29fd49d63d0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.493041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.493633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.493913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.494185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.494992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:48.495292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.496703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.513933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 625/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:48.519737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.620173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6c20-2d24-4b90-9c9c-70c3a4a6e786 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.652752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.653383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.653664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.653938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.664892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.666342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:48.681905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:48.683456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:48.684421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:48.684421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:48.684421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:48.684421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:48.684421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 603/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:48.688994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.788908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e17bb-5bda-4a52-bf4c-bd2bbc1d6a04 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.791201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:48.822343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.822977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.823293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.823594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.824278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:48.824580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.825937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.837105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 626/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:48.842857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:48.852809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:48.942203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6a7f-73e9-4a9f-95e5-4e131c66123c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:48.975917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:48.976545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:48.976828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:48.977104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:48.984576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:48.990874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:54:48.997512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:48.998626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:48.999917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 604/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:49.004754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:49.102988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fac812-46ce-42b1-8d13-d016179fef6b None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:49.136819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:49.137434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:49.137715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:49.137991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:49.138765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:49.139074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:49.140499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0c4c3-2268-4d5c-a87c-03a015f60598 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:49.152743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 627/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:49.158898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:49.223696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:49.258456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8cf0b-3fbe-43fe-9a51-e9ac81abe389 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:49.292187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:49.293106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:49.293387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:49.293661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/f523bf78506741138174ea01898f58df/roles/9c540378e4744cecbe7826cd969e53a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:49.309639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=f523bf78506741138174ea01898f58df, role_id=9c540378e4744cecbe7826cd969e53a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:49.311134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3c099-4261-447c-8f35-78eb4caf6fbd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:49.382534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 605/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:54:49 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/f523bf78506741138174ea01898f58df/roles/9c540378e4744cecbe7826cd969e53a3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:51.393308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea00c7c-52f5-48a3-b36e-73fbbfae07e4 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:51.393862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea00c7c-52f5-48a3-b36e-73fbbfae07e4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:51.393862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea00c7c-52f5-48a3-b36e-73fbbfae07e4 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:51.395265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 628/1233] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:51.401289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:51.401758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:51.401851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:51.420411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:51.421574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:51.486356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 606/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:51.510183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea00c7c-52f5-48a3-b36e-73fbbfae07e4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:51.535018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:51.610445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea00c7c-52f5-48a3-b36e-73fbbfae07e4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:51.644843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:51.645409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:51.645688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:51.645962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:51.656044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:54:51.660923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:51.662577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:51.663806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 629/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Aug 3 12:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:51.669207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:51.716419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:51.769379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b662a-b93b-4ba3-8672-d4775b18a90c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:51.803923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:51.804555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:51.804835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:51.805105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:51.805827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:51.806110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:51.807511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:51.815312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 607/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Aug 3 12:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:51.821122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:51.904468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:51.920579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372b9c6-93ee-4dd2-aca2-a3d92067b66e None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:51.953022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:51.953640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:51.953915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:51.954185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:51.964690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:51.966126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:51.980215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:51.986051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:51.993624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:51.993624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:51.993624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:51.993624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:51.993624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 630/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:54:51.993964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:52.088119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8084e2-0284-42d7-81ec-f0560c2f96bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:52.097018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:52.121674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:52.122280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:52.122558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:52.122896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:52.123629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:52.123960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:52.125319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:52.137398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 608/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:52.143152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:52.242168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804955a-7458-4af2-a498-5f53e2a8a47c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:52.274848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:52.275471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:52.275746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:52.276015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:52.278664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:52.283419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:52.284856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:54:52.296507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:52.297550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:52.298933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 631/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:52.304115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:52.402333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3a84-71d0-404a-8cd2-5fc8b1798f80 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:52.438255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:52.438988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:52.439304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:52.439614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:52.440400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:52.440705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:52.442194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:52.459235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 609/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:54:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:54:52.464998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:52.563530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0460ca-b677-4dda-acdd-fc25af8faece None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:52.596991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:52.597608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:52.597885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:52.598158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:52.657429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:52.664236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:52.665685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:52.758588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 632/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:54:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:54:52.764374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:52.792103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:52.861985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd62c7e-dedd-466e-8972-b36c47ef00e7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:52.897214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:52.897943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:52.898279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:52.898556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:52.908845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:52.910299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:52.925875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:52.927029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:52.933158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:52.933158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:52.933158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:52.933158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:52.933158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 610/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:52.933524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:53.029435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:53.035061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802d79-73bd-49cc-9c0f-5d0ccb8fc602 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:53.067610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:53.068789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:53.069265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:53.069539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:53.070213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:53.070559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:53.071983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:53.082865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 633/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:53.089536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:53.166923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:53.188585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0886-b594-45a1-a5f6-b8c0b9366a3a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:53.223877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:53.224602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:53.224875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:53.225147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:53.231839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:53.233281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:54:53.244681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:53.245839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:53.247054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 611/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:53.252264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:53.352824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b53e9-542c-484f-b59e-9830d8411e72 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:53.386080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:53.386693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:53.387005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:53.387381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:53.388066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:53.388370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:53.389812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12954c7-804f-4825-878f-e7e7aa0341fd None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:53.402239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 634/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:53.408405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:53.509015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55e26-575a-40f4-916c-7c065152fb24 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:53.543439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125594f-2316-47af-972a-da4471134134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:53.544116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125594f-2316-47af-972a-da4471134134 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:53.544398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125594f-2316-47af-972a-da4471134134 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:53.544670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125594f-2316-47af-972a-da4471134134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:53.545450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125594f-2316-47af-972a-da4471134134 None admin] RBAC: Adding query filter params (role.id=9c540378e4744cecbe7826cd969e53a3, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=f523bf78506741138174ea01898f58df) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:53.545755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125594f-2316-47af-972a-da4471134134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:53.547210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125594f-2316-47af-972a-da4471134134 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:53.553480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 612/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:54:53 2022] GET /identity/v3/role_assignments?user.id=f523bf78506741138174ea01898f58df&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=9c540378e4744cecbe7826cd969e53a3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:55.601549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8645-868a-4d6c-9d23-03c5988931d3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:55.602110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8645-868a-4d6c-9d23-03c5988931d3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:55.602110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d8645-868a-4d6c-9d23-03c5988931d3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:55.603526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 635/1247] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:55.608581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:55.608990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:55.609119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:55.616636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:55.628727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:55.629911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:55.696386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 613/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:55.720077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8645-868a-4d6c-9d23-03c5988931d3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:55.739199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:55.820658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d8645-868a-4d6c-9d23-03c5988931d3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:55.854508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:55.855102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:55.855387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:55.855662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:55.865678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:54:55.870617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:55.873762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:55.874901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 636/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:55.877962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:55.977704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181065e5-6c1a-4f75-8c71-5a3bd032b6da None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.006622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:56.011380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.012005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.012266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.012542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.013246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:56.013549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.014953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.023657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 614/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:56.029382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:56.105779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:56.127797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481096e-f059-485b-bb4b-5b4a67e0e0c2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.162723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.163372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.163654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.163932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.174310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.175828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:56.190297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:56.191479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:56.192437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:56.192437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:56.192437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:56.192437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:56.192437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 637/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:56.198002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:56.298226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e0585-7238-4062-9038-bba7192a6f89 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.331463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.332073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.332353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.332626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.333309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:56.333611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.335608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.347365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 615/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:56.353201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:56.452920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b035b8f-d089-4b47-b5ae-500d550bd8a4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.477495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:56.484913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.485533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.485809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.486080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.493849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.495305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:54:56.506586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:56.511446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:56.512694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 638/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:56.513872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:56.570470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:56.612610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8ea-3343-4c7e-ae5d-86eb302df4ec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.646347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.646987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.647266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.647537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.648382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:56.648689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.650119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.667668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 616/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:56.673807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:56.774871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4edd-b17b-4956-a221-ab5826cdeeea None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:56.808812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:56.809419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:56.809772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:56.810041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:56.862867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:56.875647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:56.877081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:56.972750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 639/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:54:56.979156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:57.078916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4d53-66ce-4524-90fb-36ca206861b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:57.092341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:57.113241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:57.113880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:57.114158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:57.114435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:57.124248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:57.125684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:54:57.140779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:57.141897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:57.143075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:54:57.143075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:54:57.143075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:54:57.143075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:57.143075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 617/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:57.148633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:57.235080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:57.247255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfee0d-7a26-4119-bbff-376fb4a4a171 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:57.279909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:57.280508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:57.280865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:57.281150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:57.281827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:57.282126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:57.283506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:57.294989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 640/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:57.301142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:57.402692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194fc8c-71f5-4b13-83db-986fd8ddd625 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:57.436537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:57.437198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:57.437477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:57.437749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:57.444958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:57.446389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:54:57.457408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:57.458470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:54:57.459642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 618/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:57.464899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:57.565517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc83722-c20c-4b50-b3bb-16c2a21d2cf2 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:57.597159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:57.597766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:57.598041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:57.598310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:57.599074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:57.599904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:57.601319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f7fb0-d87a-4d62-bd26-b3c3157858f0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:57.613961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 641/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:57.620519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:57.647714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:57.722579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7aa-46c6-48b7-b451-229f6d195df9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:57.756729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:57.757331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:57.757609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:57.758068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:57.758887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=f523bf78506741138174ea01898f58df) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:57.759197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:57.760637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64a257-8d92-4af3-9267-aa193963d3b4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:57.765946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 619/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:54:57 2022] GET /identity/v3/role_assignments?user.id=f523bf78506741138174ea01898f58df&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:59.722971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15276a8e-b7b4-4b64-9895-5eb99dde1438 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:59.723408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15276a8e-b7b4-4b64-9895-5eb99dde1438 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:59.723500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15276a8e-b7b4-4b64-9895-5eb99dde1438 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:59.725953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 642/1261] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:54:59.731066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:59.731521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:59.731616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:59.749119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:59.750299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:59.815920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 620/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:54:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:54:59.839710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15276a8e-b7b4-4b64-9895-5eb99dde1438 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:59.850910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:59.940571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15276a8e-b7b4-4b64-9895-5eb99dde1438 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:59.974283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:59.974878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:59.975153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:59.975430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:59.985175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:54:59.990071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:54:59.992931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:54:59.994043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 643/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:54:59.997377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.018017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:00.097793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b530b3-442d-4262-8a03-38d9ec5f226a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.131445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.132200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.132478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.132748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.133447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:00.133744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.135136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.142935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 621/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:00.149628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.216533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:00.249033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82b538-3254-45ae-9607-63759541f55c None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.282430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.283084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.283361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.283631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.293503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.294982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:55:00.309436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:00.310522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:00.311635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:55:00.311635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:55:00.311635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:00.311635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:00.311635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 644/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:00.316369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.398069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:00.416735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722f8d-ba02-449a-8c11-1dbd76463aa6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.450261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.450897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.451179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.451450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.452125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:00.452425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.453795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.466003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 622/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:00.471818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.570874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c8f1-74f5-40a8-a71d-9dfab8f37aa6 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.589824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:00.603636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.604261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.604534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.604801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.611962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.613375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:55:00.624936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:00.626190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:00.629018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 645/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:00.632323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.732464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b47a0-bf76-455a-901d-80862c40a719 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.766986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.767628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.767908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.768226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.769003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:00.769306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.770743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.779442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:00.788606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 623/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:00.794734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:00.894084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc368b4c-2558-46a6-8557-ac98960d1f64 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:00.927670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:00.928440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:00.928716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:00.928985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:00.939152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:00.940634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:55:00.955374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:00.958365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:00.960587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:55:00.960587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:55:00.960587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:00.960587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:00.960587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 646/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:00.963152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:01.062705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589842c-d9ca-4529-85cd-ee54dedc8ac5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:01.097125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:01.097731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:01.098012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:01.098284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:01.098997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:01.099903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:01.101411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:01.112608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 624/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:01.118336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:01.152045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:01.218310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01920511-7a46-4d58-88d3-abb0f7eee382 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:01.250655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:01.251305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:01.251583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:01.251855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:01.258895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:01.260321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:55:01.272639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:01.277755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:01.278911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 647/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:55:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:01.280419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:01.340912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:01.382538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4e02-6916-47ef-8ce7-5d8481c1472f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:01.414523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:01.415076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:01.415350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:01.415619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:01.416354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:01.416655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:01.418331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c687bc-272f-4820-a505-6529ea369904 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:01.430542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 625/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:01.436680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:01.525576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:01.534049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab3d-a064-45f8-9da7-c4374c00dac4 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:01.569109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:01.569770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:01.570051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:01.570330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] PATH_INFO: `/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/f523bf78506741138174ea01898f58df/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:01.572267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6b843647f6493fba5ea204a7010d71, user_id=f523bf78506741138174ea01898f58df, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:01.573688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b5d2-2415-4229-8a7e-18f79489ede9 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:01.715291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 648/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Aug 3 12:55:01 2022] PUT /identity/v3/projects/8c6b843647f6493fba5ea204a7010d71/users/f523bf78506741138174ea01898f58df/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:55:03.723413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550767a-4618-4ef7-9fa5-a173b65862c4 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:03.723948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550767a-4618-4ef7-9fa5-a173b65862c4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:03.723948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550767a-4618-4ef7-9fa5-a173b65862c4 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:03.725351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 626/1274] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:03.730532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:03.730973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:03.731121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:03.749043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:03.750248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:03.815790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 649/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:55:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:55:03.839736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550767a-4618-4ef7-9fa5-a173b65862c4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:03.941611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550767a-4618-4ef7-9fa5-a173b65862c4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:03.959608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:03.976511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:03.977140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:03.977418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:03.977687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:03.987769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:55:03.992954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:03.994096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:03.995105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 627/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Aug 3 12:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:04.000319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.077979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:04.095385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a246e92-eb14-4e32-a4b5-299754fb3208 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.127450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.128053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.128329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.128597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.129296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:04.129595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.131084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:04.138575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 650/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Aug 3 12:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:04.144541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.248005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba831-e441-483b-b8b7-fc122e73442e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.282002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.282669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.284309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.284309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.293647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.295167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:55:04.309647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:04.310812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:04.311767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:55:04.311767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:55:04.311767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:04.311767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:04.311767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 628/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:04.316732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.414822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0832fa-3ca0-4b9b-b839-c83b52d469ec None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.448145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.448751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.449032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.449306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.449988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:04.450292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.451677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:04.463259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 651/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:04.469001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.500717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:04.573994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0e857-88a1-48a2-a799-a8db37b1f3ea None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.607016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.607973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.608248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.608545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.617339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.618799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:55:04.629673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:04.630741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:04.631758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 629/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:04.637014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.640839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:04.735483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ebde3-5d02-49d7-8ccc-4327713800ec None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.767549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.768133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.768406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.768673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.769456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:04.769751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.771755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:04.788912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 652/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Aug 3 12:55:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:04.795020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:04.883531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:04.892666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a9b39-7477-4ae4-8a70-a1943b66a3e5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:04.926864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:04.927496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:04.927830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:04.928104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:04.995118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:04.996647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.085291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:05.095461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 630/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Aug 3 12:55:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:55:05.101649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.161677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:05.199189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c008c-53fc-4aa5-8971-4fe5b35d534f None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.232440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.233068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.233350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.233641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.243453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.246250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:55:05.260082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:05.261155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:05.262238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:55:05.262238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:55:05.262238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:55:05.262238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:05.263001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 653/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:05.268606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.368262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765e8f-b8d4-44d6-b14d-d6d10c21e781 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.401456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.402064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.402342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.402613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.403325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:05.403626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.405020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.416567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 631/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:05.422551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.520203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee302c13-b6a1-4c3b-a55e-8a17ec9ae965 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.533895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:05.553749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.554369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.554672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.555009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.561428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.562897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:55:05.574033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:05.580002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: ERROR keystone.server.flask.application Aug 03 12:55:05.581232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 654/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:05.581902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.631219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:05.680359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13f477-6220-4c59-af74-f59fe60d936b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.714722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.715407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.715737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.716012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.716758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:05.717064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.718524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b000f5-dd48-48fd-9786-657d84bb1f5b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.731130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 632/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:05.737280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.836018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120f33e-a299-4988-aed6-469539c84f42 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.869077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.869674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.869954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.870229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.871042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] RBAC: Adding query filter params (role.id=43d4d104da3d43f8b37c7b40de6d6c84, scope.project.id=8c6b843647f6493fba5ea204a7010d71, user.id=f523bf78506741138174ea01898f58df) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:05.871415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.872830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d61bf4-068e-481b-acc8-8c75f3e9044c None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.882109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 655/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/role_assignments?user.id=f523bf78506741138174ea01898f58df&scope.project.id=8c6b843647f6493fba5ea204a7010d71&role.id=43d4d104da3d43f8b37c7b40de6d6c84 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:07.930466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b215-4b80-4766-96d8-58ece26c4968 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:07.931050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b215-4b80-4766-96d8-58ece26c4968 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:07.931050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b215-4b80-4766-96d8-58ece26c4968 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:07.932373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 633/1288] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:07.937449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:07.937868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:07.938028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:07.956684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:07.957569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:07.987837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:08.024894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 656/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:55:08.047586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b215-4b80-4766-96d8-58ece26c4968 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:08.149438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b215-4b80-4766-96d8-58ece26c4968 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:08.160674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:08.183966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:08.184596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:08.184875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:08.185145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:08.185759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:08.187151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:08.195887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:08.197512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:08.198405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 634/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:55:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:08.203172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:08.299720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92674e-9fea-4792-94f3-18110865e26e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:08.333228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:08.333904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:08.334180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:08.334451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:08.335143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:08.335444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:08.336928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29c065-71a8-4e74-b79a-096561d4a4a7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:08.341658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 657/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Aug 3 12:55:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:08.347474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:08.447737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefedc93-29b1-469b-8fa2-34ef64401565 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:08.481643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:08.482273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:08.482549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:08.482844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:08.483505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:08.483801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:08.485236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d148b-9686-4cb4-a6b4-85b5cd8d06a9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:08.489571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 635/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Aug 3 12:55:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:10.434069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50e6a-1aed-4948-be95-06c07efe8d5d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:10.434625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50e6a-1aed-4948-be95-06c07efe8d5d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:10.434625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50e6a-1aed-4948-be95-06c07efe8d5d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:10.436002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 658/1293] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:10.441023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e52260-436b-4501-ab9c-f8bcab7b8180 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:10.441462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e52260-436b-4501-ab9c-f8bcab7b8180 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:10.441578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e52260-436b-4501-ab9c-f8bcab7b8180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:10.461249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-85e52260-436b-4501-ab9c-f8bcab7b8180 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:10.462423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-85e52260-436b-4501-ab9c-f8bcab7b8180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:10.492615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:10.530047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 636/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:55:10.553150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50e6a-1aed-4948-be95-06c07efe8d5d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:10.584799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:10.654255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50e6a-1aed-4948-be95-06c07efe8d5d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:10.687336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:10.687885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:10.688160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:10.688431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:10.689122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:10.690473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48f681-83f8-46d8-af65-0558bf9c62c4 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:10.760824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 659/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Aug 3 12:55:10 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:55:12.776441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a8690-beef-47c2-9ff5-1889b6a6b415 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:12.776955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a8690-beef-47c2-9ff5-1889b6a6b415 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:12.777047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a8690-beef-47c2-9ff5-1889b6a6b415 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:12.778353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 637/1296] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:12.783475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:12.783868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:12.784061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:12.803206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:12.804535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:12.877692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 660/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:55:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:55:12.901557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a8690-beef-47c2-9ff5-1889b6a6b415 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:13.003784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a8690-beef-47c2-9ff5-1889b6a6b415 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:13.037566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:13.038215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:13.038584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:13.038848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:13.039464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:13.040824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:13.050021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:13.051287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:13.052511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 638/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:55:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:13.057633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:13.075463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:13.153668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda497d-aa11-49a4-801b-daf823130e88 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:13.187213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:13.187825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:13.188105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:13.188378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:13.189052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:13.189362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:13.191919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:13.197275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 661/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Aug 3 12:55:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:13.203260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:13.236239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:13.304366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b851a57-829c-4ebd-a63b-2da98527f4b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:13.336756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:13.337428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:13.337773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:13.338044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:13.338819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] RBAC: Adding query filter params (interface=public, service_id=f1aad9c04f5c4cc28687b47ef3ae5742, region_id=RegionOne) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:13.339125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:13.340485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f638d-4694-49bf-adeb-89ebf3b4c4a1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:13.345398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 639/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Aug 3 12:55:13 2022] GET /identity/v3/endpoints?service_id=f1aad9c04f5c4cc28687b47ef3ae5742&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:13.351761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:13.433579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:13.451013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f93f0-4f6e-4838-a986-8aaf190fcca0 None admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:13.484299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:13.484913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:13.485188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:13.485462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:13.486104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:13.487485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419438-00c6-42a9-8fea-6252a2384dc7 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:13.494776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 662/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Aug 3 12:55:13 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:55:15.455974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ed254-9e27-49ee-9a76-fcb7d21c63a9 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:15.456535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ed254-9e27-49ee-9a76-fcb7d21c63a9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:15.456535 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ed254-9e27-49ee-9a76-fcb7d21c63a9 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:15.457900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 640/1302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 12:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:15.463698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:15.464137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:15.464255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:15.483051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:15.484239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:15.550408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 663/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 12:55:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:55:15.573638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ed254-9e27-49ee-9a76-fcb7d21c63a9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:15.668972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:15.675622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ed254-9e27-49ee-9a76-fcb7d21c63a9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:15.709644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:15.710298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:15.710582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:15.710898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:15.711523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:15.712948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:55:15.722490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:55:15.723589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Aug 03 12:55:15.726085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 641/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Aug 3 12:55:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:55:15.730261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:15.804652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:15.826846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8958056-c8e1-4a51-af67-5426a4d729b9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:15.861195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:15.861846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:15.862121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:15.862391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] PATH_INFO: `/v3/services` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:15.863122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:55:15.863422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:15.864769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124565-710d-4444-8a58-738ac8d68a61 None admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:15.870840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 664/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Aug 3 12:55:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:55:15.876664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:15.977485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38893-88ab-4cad-ac1f-9f40dfc18e8f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:16.009984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:16.010590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:16.010906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:16.011181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:16.011891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:16.013251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5dd97-b9db-4471-8b8a-0ec4bee8b641 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:16.137168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 642/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 12:55:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:55:25.867848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=30 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:26.132512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.616450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef17c4-05c0-4ba2-9d00-163aa7513755 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.617018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef17c4-05c0-4ba2-9d00-163aa7513755 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.617018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef17c4-05c0-4ba2-9d00-163aa7513755 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.623443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6e73-be6c-4eff-b77d-7ff351b9b786 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.628906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6e73-be6c-4eff-b77d-7ff351b9b786 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.628906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b6e73-be6c-4eff-b77d-7ff351b9b786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.629099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 665/1307] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:22.714235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1f1b6e73-be6c-4eff-b77d-7ff351b9b786 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.715883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1f1b6e73-be6c-4eff-b77d-7ff351b9b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.890630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 643/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:22.956493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.956493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.956493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.956493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 666/1309] 10.222.0.67 () {54 vars in 965 bytes} [Wed Aug 3 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:22.959667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651c33-0ef0-4df7-984f-38f7bde52696 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.959930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651c33-0ef0-4df7-984f-38f7bde52696 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.960280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5651c33-0ef0-4df7-984f-38f7bde52696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.100308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c5651c33-0ef0-4df7-984f-38f7bde52696 None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:23.101738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c5651c33-0ef0-4df7-984f-38f7bde52696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.127302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.197783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 644/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:23.206900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.209066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.340839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159bb1d-5986-4dba-af8b-6477e20cfcaf None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.417492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.418035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.418313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.418585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.420242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.475982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.536555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.538192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c56bc8-d5f4-4641-9069-6fb18b043aae service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.560612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 667/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:25.935609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:25.936165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:25.936165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:25.937538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 645/1312] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:25.943322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1e2a-b0ce-4aac-8f96-2312910708de None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:25.943737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1e2a-b0ce-4aac-8f96-2312910708de None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:25.944017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1e2a-b0ce-4aac-8f96-2312910708de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:26.029267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bbed1e2a-b0ce-4aac-8f96-2312910708de None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:26.030414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bbed1e2a-b0ce-4aac-8f96-2312910708de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:26.126081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 668/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:26.166549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:26.168339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:26.294621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7793f3-9561-4fe5-a9c2-c782a9231240 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:26.367538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:26.370127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:26.370779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:26.371063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:26.371339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:26.372973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:26.484757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:26.486204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afde6b-e025-4258-97ca-5976ad18a79e service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:26.504995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 646/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:28.990532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:28.991084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:28.991084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:28.992374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 669/1315] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:28.997503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41795-a6bc-4938-b490-9826654bfd1a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:28.997880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41795-a6bc-4938-b490-9826654bfd1a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:28.998052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f41795-a6bc-4938-b490-9826654bfd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:29.063646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-30f41795-a6bc-4938-b490-9826654bfd1a None None] MFA Rules not processed for user `0ad0a36cb2094e56afa21fbf052c8ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:29.064851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-30f41795-a6bc-4938-b490-9826654bfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:29.118443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.162926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 647/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:29.203262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:29.204806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:29.215039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.306779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c126-71b6-4d1b-8aef-00aba342db13 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:29.378248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:29.378888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:29.379170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:29.379443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:29.381059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:29.442466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.488253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:29.489671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034e687-1bfb-4fdc-bf74-b53676ba915d service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:29.508428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 670/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:32.415975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:32.416512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:32.416512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:32.417883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 648/1318] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:32.422940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55b7ec-a7d1-4b81-892f-d7f54acc4d09 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:32.423362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55b7ec-a7d1-4b81-892f-d7f54acc4d09 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:32.423486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55b7ec-a7d1-4b81-892f-d7f54acc4d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:32.488101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cc55b7ec-a7d1-4b81-892f-d7f54acc4d09 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:32.489302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cc55b7ec-a7d1-4b81-892f-d7f54acc4d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:32.590677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 671/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:32.631082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:32.633196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:32.740748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998266d-76c9-4206-941f-8c4ba0826b18 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:32.814661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:32.816077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:32.816450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:32.816726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:32.818328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:32.825165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:32.927085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:32.928524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8ffe1-82ec-496d-b37e-046e6429f2f4 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:32.946789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 649/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:35.965040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661156-a743-4490-a1ca-3cad3d77be9a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:35.965571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661156-a743-4490-a1ca-3cad3d77be9a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:35.965571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661156-a743-4490-a1ca-3cad3d77be9a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:35.966886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 672/1321] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:35.973019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e439-66b0-432c-bc15-08226f373b4b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:35.973453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e439-66b0-432c-bc15-08226f373b4b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:35.973670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e439-66b0-432c-bc15-08226f373b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:36.041205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4992e439-66b0-432c-bc15-08226f373b4b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:36.042410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4992e439-66b0-432c-bc15-08226f373b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:36.101518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:36.150414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 650/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:36.200914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:36.201203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:36.201480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:36.202889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 673/1323] 10.222.0.67 () {54 vars in 965 bytes} [Wed Aug 3 13:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:36.209455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb26d6-dc96-4aec-8774-2707008087bf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:36.209739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb26d6-dc96-4aec-8774-2707008087bf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:36.210013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb26d6-dc96-4aec-8774-2707008087bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:36.296582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d2bb26d6-dc96-4aec-8774-2707008087bf None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:36.297823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d2bb26d6-dc96-4aec-8774-2707008087bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:36.376742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 651/1324] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Aug 3 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:36.386757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:36.388273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:36.407619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:36.492642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e8ba1-508d-4d8e-a179-bbc084e17242 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:36.567708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:36.568326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:36.568599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:36.568864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:36.570514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:36.652502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:36.703423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:36.704998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a9d02-0e2a-4d44-bc33-c4742bb8f2c0 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:36.729240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 674/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:39.090531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:39.091138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:39.091138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:39.092470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 652/1326] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:39.098184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443112-e842-4481-a3c0-7eb46530552b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:39.098664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443112-e842-4481-a3c0-7eb46530552b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:39.098881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443112-e842-4481-a3c0-7eb46530552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:39.171531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-45443112-e842-4481-a3c0-7eb46530552b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:39.172766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-45443112-e842-4481-a3c0-7eb46530552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:39.270547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 675/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:39.306988 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:39.308548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:39.378898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:39.422419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f397ca9-9560-4a61-b358-c4ea3bee7b19 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:39.497277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:39.497901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:39.498183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:39.498460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:39.500118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:39.608866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:39.611190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:39.613316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f9504-1573-4051-bfdb-27a2773d587c service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:39.631909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 653/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:41.713944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:41.714414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:41.714512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:41.715907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 676/1329] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:41.721811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04316d-dcb5-40ea-b073-d4c63a720126 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:41.722248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04316d-dcb5-40ea-b073-d4c63a720126 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:41.722472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04316d-dcb5-40ea-b073-d4c63a720126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:41.791432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cf04316d-dcb5-40ea-b073-d4c63a720126 None None] MFA Rules not processed for user `0ad0a36cb2094e56afa21fbf052c8ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:41.792654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cf04316d-dcb5-40ea-b073-d4c63a720126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:41.892111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 654/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:41.931171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:41.932745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:41.967610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:42.044752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320af8a-a0d7-4431-986b-a5877e3d7773 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:42.117580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:42.118190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:42.118464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:42.118755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:42.120356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:42.197416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:42.229934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:42.231399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df917c5-b552-4fcd-8cf4-216181139455 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:42.249937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 677/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:44.709377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:44.709901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:44.710120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:44.711878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 655/1332] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:44.717009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca0e4-dbbc-4369-be8c-9e51086bc66e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:44.717429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca0e4-dbbc-4369-be8c-9e51086bc66e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:44.717560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eca0e4-dbbc-4369-be8c-9e51086bc66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:44.786059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f6eca0e4-dbbc-4369-be8c-9e51086bc66e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:44.787313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f6eca0e4-dbbc-4369-be8c-9e51086bc66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:44.882246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 678/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:44.919012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:44.920568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:44.990310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:45.025058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf0790-8b44-4fed-aa5b-7a22dfe4f097 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:45.099613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:45.100228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:45.100505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:45.100777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:45.102393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:45.210893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:45.212285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768cf00-976c-4de0-a6ca-13082c6ac012 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:45.223193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:45.231270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 656/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:47.278818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:47.279353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:47.279481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:47.280756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 679/1335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:47.286523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0799-9c63-4e86-8f3e-030067fdf305 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:47.286942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0799-9c63-4e86-8f3e-030067fdf305 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:47.287141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0799-9c63-4e86-8f3e-030067fdf305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:47.352034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1e2f0799-9c63-4e86-8f3e-030067fdf305 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:47.353233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1e2f0799-9c63-4e86-8f3e-030067fdf305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:47.448780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 657/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:47.489675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:47.491238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:47.531903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:47.595888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ced95-d4ac-4623-8114-d022a8311612 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:47.668349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:47.668976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:47.669261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:47.669568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:47.671261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:47.754087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:47.779662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:47.781672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29339d-7782-4a80-aace-2e5943a9a142 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:47.799602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 680/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:50.416873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:50.417407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:50.417407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:50.418810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 658/1338] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:50.424490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d899-fd3c-4ce1-9a45-e93345ec4bc4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:50.424908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d899-fd3c-4ce1-9a45-e93345ec4bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:50.425041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d899-fd3c-4ce1-9a45-e93345ec4bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:50.490111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c035d899-fd3c-4ce1-9a45-e93345ec4bc4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:50.491325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c035d899-fd3c-4ce1-9a45-e93345ec4bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:50.585632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 681/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:50.622202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:50.623778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:50.700841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:50.728480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4f52c-42d7-402a-b24b-7e62af4fd974 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:50.802086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:50.802700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:50.803008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:50.803279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:50.804910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:50.912275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:50.914063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d6bd5-9118-41f4-84e6-a3bcb881f5e7 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:50.931717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 659/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:55.147722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e5d6-181f-4562-b047-3869914b952a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.148255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e5d6-181f-4562-b047-3869914b952a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.148255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002e5d6-181f-4562-b047-3869914b952a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.149672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 682/1341] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:55.155171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11983-ba32-4611-b2a9-0d06e5abe2c5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.155630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11983-ba32-4611-b2a9-0d06e5abe2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.155737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11983-ba32-4611-b2a9-0d06e5abe2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.162386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:55.224811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-40e11983-ba32-4611-b2a9-0d06e5abe2c5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:55.226008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-40e11983-ba32-4611-b2a9-0d06e5abe2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.326055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 660/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:55.365810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002e5d6-181f-4562-b047-3869914b952a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:55.367417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1002e5d6-181f-4562-b047-3869914b952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.416081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:55.470647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002e5d6-181f-4562-b047-3869914b952a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:55.543627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:55.544240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.544522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.544795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.546420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.640238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:55.656777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:55.658224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fed6e7-5404-45eb-8767-47891242a67f service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:55.677145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 683/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:58.642506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:58.643094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:58.643094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:58.644542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 661/1344] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:01:58.649920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4198d8-8da9-41f6-8438-503d4d723146 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:58.650351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4198d8-8da9-41f6-8438-503d4d723146 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:58.650446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4198d8-8da9-41f6-8438-503d4d723146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:58.719067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7e4198d8-8da9-41f6-8438-503d4d723146 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:58.720278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7e4198d8-8da9-41f6-8438-503d4d723146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:58.816530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 684/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:58.854078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:58.855639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:58.943135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:58.959454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc41b7-8eb4-46a5-9239-64884d462372 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:59.036223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:59.036845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:59.037122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:59.037392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:59.039026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:59.148404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:59.149852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48b888-2492-4747-bcd8-10856ad9c917 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:59.172133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 662/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:03.484841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.485435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.485435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.486943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 685/1347] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:03.492870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87be8-9dcd-4914-8c89-9d4dac8b6347 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.493375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87be8-9dcd-4914-8c89-9d4dac8b6347 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.493547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87be8-9dcd-4914-8c89-9d4dac8b6347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.509986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:03.565959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-10d87be8-9dcd-4914-8c89-9d4dac8b6347 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:03.568589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-10d87be8-9dcd-4914-8c89-9d4dac8b6347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.670675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 663/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:03.709408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.710987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.771023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:03.819373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdae2c-914a-400b-accf-ce145f5cb28a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.894599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.895253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.895532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.895801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.897438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:04.011335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:04.015013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:04.019312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8eef-d542-4926-aa8a-85d26c6566e6 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:04.035196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 686/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:08.941344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb522-34c0-4280-ae84-ee0ceb279d9b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:08.942005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb522-34c0-4280-ae84-ee0ceb279d9b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:08.942104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb522-34c0-4280-ae84-ee0ceb279d9b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:08.943708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 664/1350] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:08.948761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042a586-42bd-4fe8-aa2e-ce90cd10c6fe None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:08.949155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042a586-42bd-4fe8-aa2e-ce90cd10c6fe None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:08.949298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042a586-42bd-4fe8-aa2e-ce90cd10c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:09.059606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d042a586-42bd-4fe8-aa2e-ce90cd10c6fe None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:09.061191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d042a586-42bd-4fe8-aa2e-ce90cd10c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:09.225544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 687/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:13.452512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5850-052c-4d25-93eb-627fd6fa05eb None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:13.453058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5850-052c-4d25-93eb-627fd6fa05eb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:13.453058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5850-052c-4d25-93eb-627fd6fa05eb None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:13.454693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 665/1352] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:13.459757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9b05-abe6-44cb-b468-cb1ed7362641 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:13.460228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9b05-abe6-44cb-b468-cb1ed7362641 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:13.460314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea9b05-abe6-44cb-b468-cb1ed7362641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:13.518673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:13.543812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-50ea9b05-abe6-44cb-b468-cb1ed7362641 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:13.545027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-50ea9b05-abe6-44cb-b468-cb1ed7362641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:13.665754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 688/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:13.668748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=59 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:14.879517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feabe1-e04f-4d8e-84e9-3054e9193651 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.880118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feabe1-e04f-4d8e-84e9-3054e9193651 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.880216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feabe1-e04f-4d8e-84e9-3054e9193651 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.881508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 666/1354] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:14.887060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ee07-591f-4bf8-afd9-c631c8c3bff2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:14.887497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ee07-591f-4bf8-afd9-c631c8c3bff2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:14.887660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ee07-591f-4bf8-afd9-c631c8c3bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:14.969131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7691ee07-591f-4bf8-afd9-c631c8c3bff2 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:14.970329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7691ee07-591f-4bf8-afd9-c631c8c3bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:15.013873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:15.079243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 689/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:18.538363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac0f9-d4bb-4b17-84a2-dd5f64d51d0c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.538948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac0f9-d4bb-4b17-84a2-dd5f64d51d0c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.538948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac0f9-d4bb-4b17-84a2-dd5f64d51d0c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.541309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 667/1356] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:18.547665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380792-2d33-4d68-ba78-078fcab86ac0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.548118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380792-2d33-4d68-ba78-078fcab86ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.548359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380792-2d33-4d68-ba78-078fcab86ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.634260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-35380792-2d33-4d68-ba78-078fcab86ac0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:18.635684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-35380792-2d33-4d68-ba78-078fcab86ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:18.753393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 690/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:18.808017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.808296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.808737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.810456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 668/1358] 10.222.0.67 () {54 vars in 962 bytes} [Wed Aug 3 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:18.819040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651b93a-ebdc-4d00-a3e4-d7f5fbcf5553 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.819482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651b93a-ebdc-4d00-a3e4-d7f5fbcf5553 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.819864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651b93a-ebdc-4d00-a3e4-d7f5fbcf5553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.838470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:18.903023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0651b93a-ebdc-4d00-a3e4-d7f5fbcf5553 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:18.904187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0651b93a-ebdc-4d00-a3e4-d7f5fbcf5553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.026417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 691/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Aug 3 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:19.034318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.035858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.188116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475b329-ad47-4c22-bb2d-d256b24bf4e8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.278427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:19.321841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.322459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.322753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.323031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.325455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.425459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.427317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d94-b472-4901-8e78-d088147eaaf0 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.458038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 669/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:21.698204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:21.698204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:21.698204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:21.701478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 692/1361] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:21.705297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086181b4-2ac5-4709-b52c-67152de0f2b2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:21.708057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086181b4-2ac5-4709-b52c-67152de0f2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:21.708057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086181b4-2ac5-4709-b52c-67152de0f2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:21.781446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-086181b4-2ac5-4709-b52c-67152de0f2b2 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:21.782757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-086181b4-2ac5-4709-b52c-67152de0f2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:21.824539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:21.890778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 670/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:21.937655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:21.939227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:22.040536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:22.136308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b00f5e-88f6-4482-ba54-c49405b0706d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:22.273669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:22.274070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:22.274352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:22.274671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:22.276371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:22.302168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:22.372563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:22.374170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a6e0a-b584-4cda-b6e4-cab4dd49a018 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:22.392909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 693/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:24.921743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23449f-4286-4985-9449-3e8660ce115d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.922572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23449f-4286-4985-9449-3e8660ce115d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.923026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23449f-4286-4985-9449-3e8660ce115d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.928802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 671/1364] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:24.930307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd6b74-4483-46fb-ac75-34bdf998f06f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.930759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd6b74-4483-46fb-ac75-34bdf998f06f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.930938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd6b74-4483-46fb-ac75-34bdf998f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.009465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-adbd6b74-4483-46fb-ac75-34bdf998f06f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:25.010680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-adbd6b74-4483-46fb-ac75-34bdf998f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.111767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:25.114772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 694/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:25.165258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.165624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.165978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.167886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 672/1366] 10.222.0.67 () {54 vars in 962 bytes} [Wed Aug 3 13:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:25.173924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7939-97e0-4f74-b43e-1bc23d1b3e01 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.174970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7939-97e0-4f74-b43e-1bc23d1b3e01 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.181045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb7939-97e0-4f74-b43e-1bc23d1b3e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.260749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d0cb7939-97e0-4f74-b43e-1bc23d1b3e01 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:25.261973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d0cb7939-97e0-4f74-b43e-1bc23d1b3e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.391326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 695/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Aug 3 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:25.400578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:25.402244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.570628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747780ea-d29e-4eb6-ba68-bc0bc83473e5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.592598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:25.701161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.701804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.702088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.702366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.704067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.801868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.803500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6888-7e76-436c-bf6d-2270ece5a8bd service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.824023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 673/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:26.740972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96aa8-a4e8-472a-9d16-814297b4dd18 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:26.741500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96aa8-a4e8-472a-9d16-814297b4dd18 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:26.742046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96aa8-a4e8-472a-9d16-814297b4dd18 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:26.743639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 696/1369] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:26.749603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8073b3-6854-466e-8091-5ecfec3bae9b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:26.750064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8073b3-6854-466e-8091-5ecfec3bae9b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:26.750147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8073b3-6854-466e-8091-5ecfec3bae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:26.786269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:26.831156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5f8073b3-6854-466e-8091-5ecfec3bae9b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:26.831156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5f8073b3-6854-466e-8091-5ecfec3bae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:26.945625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 674/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:27.293447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:27.293447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:27.293447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:27.296451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 697/1371] 10.222.0.67 () {54 vars in 964 bytes} [Wed Aug 3 13:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:27.299934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42f86-766a-4f18-9ea9-cc67c368c2d2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:27.300217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42f86-766a-4f18-9ea9-cc67c368c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:27.300491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42f86-766a-4f18-9ea9-cc67c368c2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:27.383742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-69b42f86-766a-4f18-9ea9-cc67c368c2d2 None None] MFA Rules not processed for user `e31fc272e5f24eac95630f0fced91df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:27.384993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-69b42f86-766a-4f18-9ea9-cc67c368c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:27.438128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:27.470848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 675/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Aug 3 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:27.477299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:27.478825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:27.531600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:27.591459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a496420-4d6d-4b41-8bc8-819d67a1caf1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:27.670701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:27.671836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:27.672347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:27.672844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:27.675280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:27.778845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:27.792616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:27.794065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c0c1-34bf-427d-a0f5-7790e0618202 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:27.813225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 698/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:28.079463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.080620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.080620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.087169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 676/1374] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:28.087390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12a69-9854-4fb9-b749-973c4d3b6071 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.087390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12a69-9854-4fb9-b749-973c4d3b6071 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.087390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12a69-9854-4fb9-b749-973c4d3b6071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.169006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0ec12a69-9854-4fb9-b749-973c4d3b6071 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:28.170126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0ec12a69-9854-4fb9-b749-973c4d3b6071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:28.278994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 699/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:28.319493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:28.321020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:28.471630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7828ac-44de-4630-860e-874dee4e17ad None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:28.523676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:28.587261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:28.587880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.588161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.588425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.590067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:28.683084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:28.687658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f65749-4e93-4ea3-9e88-11d5a795974e service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:28.704206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 677/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:30.883909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.884408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.884504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.885836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 700/1377] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:30.890949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221030-09df-4379-809f-197870fceae4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.891356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221030-09df-4379-809f-197870fceae4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.891526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221030-09df-4379-809f-197870fceae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.982771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-49221030-09df-4379-809f-197870fceae4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:30.983900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-49221030-09df-4379-809f-197870fceae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:30.990907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:31.083237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 678/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:31.126697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:31.128834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:31.190774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:31.281330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411401-c05c-4c08-a37c-3a0ec996cc7e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:31.459843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:31.460368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:31.460735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:31.461010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:31.462844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:31.485368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:31.568306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:31.570229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a45fab-5c24-4c75-a6da-d557dc0d1449 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:31.593904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 701/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:33.747155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:33.747694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:33.747694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:33.753455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 679/1380] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:33.754876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7773-d7bd-473c-8b2b-e42625f53f88 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:33.755322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7773-d7bd-473c-8b2b-e42625f53f88 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:33.755406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7773-d7bd-473c-8b2b-e42625f53f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:33.825848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a73b7773-d7bd-473c-8b2b-e42625f53f88 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:33.827090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a73b7773-d7bd-473c-8b2b-e42625f53f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:33.957688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:33.966752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 702/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:34.009813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:34.011353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:34.170402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:34.181308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4cc9d-5eea-4850-bd0c-a843bba2d318 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:34.375382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:34.375382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:34.375382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:34.375382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:34.375872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:34.426876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:34.426876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9628e7-ea13-44a3-980a-884510dd4bb7 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:34.432931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 680/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:34.473474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:36.722356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:36.722938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:36.723041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:36.724399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 703/1383] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:36.730649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc328-80bc-43bb-bab5-2245666c2529 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:36.731096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc328-80bc-43bb-bab5-2245666c2529 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:36.731253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc328-80bc-43bb-bab5-2245666c2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:36.804523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7ecdc328-80bc-43bb-bab5-2245666c2529 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:36.805866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7ecdc328-80bc-43bb-bab5-2245666c2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:36.919703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 681/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:36.970634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:36.973047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.131474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d433cf-905a-4ffe-8083-ffe262f58ca7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.214855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:37.270818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515690-2375-417f-87b0-975bebfe811e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.271446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515690-2375-417f-87b0-975bebfe811e service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.271727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515690-2375-417f-87b0-975bebfe811e service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.272005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515690-2375-417f-87b0-975bebfe811e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.273672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-91515690-2375-417f-87b0-975bebfe811e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.367121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91515690-2375-417f-87b0-975bebfe811e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.368759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91515690-2375-417f-87b0-975bebfe811e service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.387916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 704/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:39.636901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.637489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.637607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.639250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 682/1386] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:39.645797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20371-3141-4cc3-a85a-674740221726 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.646388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20371-3141-4cc3-a85a-674740221726 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.646388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20371-3141-4cc3-a85a-674740221726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.720736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-aec20371-3141-4cc3-a85a-674740221726 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:39.722462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aec20371-3141-4cc3-a85a-674740221726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.762850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:39.836897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 705/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:39.901533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.903368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.982960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:40.056984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49125b0d-2d85-4ddc-9f5f-1e36b811b8b0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:40.202995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:40.203617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:40.203915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:40.204175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:40.206799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:40.247124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:40.304640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:40.306290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23199445-a816-43ae-a0ed-68367a3cc053 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:40.325310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 683/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:42.667153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:42.667714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:42.667714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:42.669068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 706/1389] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:42.675076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644eb-b9fa-4c1b-8ae5-beeb1638fb0d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:42.675500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644eb-b9fa-4c1b-8ae5-beeb1638fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:42.675707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644eb-b9fa-4c1b-8ae5-beeb1638fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:42.750039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a85644eb-b9fa-4c1b-8ae5-beeb1638fb0d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:42.751282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a85644eb-b9fa-4c1b-8ae5-beeb1638fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:42.850932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 684/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:42.895340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:42.896936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.046663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcd3ae-f66a-42e1-84b3-383432fc4f68 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:43.064431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:43.164791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:43.165328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.165610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.165888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.167598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.169198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ae7-577f-477b-9f00-1dae46a93d84 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.169490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ae7-577f-477b-9f00-1dae46a93d84 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.169769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ae7-577f-477b-9f00-1dae46a93d84 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.171158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 685/1391] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:02:43.177356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793695-3809-4d72-a09a-0d96c103fb8e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.177641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793695-3809-4d72-a09a-0d96c103fb8e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.177917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793695-3809-4d72-a09a-0d96c103fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.194360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:43.247185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-20793695-3809-4d72-a09a-0d96c103fb8e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:43.248407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-20793695-3809-4d72-a09a-0d96c103fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.259277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:43.260884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1632ad9-5254-4e8f-8b2e-d90d42ed8bad service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:43.279958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 707/1392] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:43.348375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 686/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:43.404298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.404589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.404870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.406230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 708/1394] 10.222.0.67 () {54 vars in 966 bytes} [Wed Aug 3 13:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:43.412249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cf0d8-c2ae-447e-9326-34daf1448a1b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.412593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cf0d8-c2ae-447e-9326-34daf1448a1b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.412871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cf0d8-c2ae-447e-9326-34daf1448a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.489660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-561cf0d8-c2ae-447e-9326-34daf1448a1b None None] MFA Rules not processed for user `6485a82c946346f9b0a53a87056116ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:43.490839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-561cf0d8-c2ae-447e-9326-34daf1448a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.531168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:43.579011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 687/1395] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Aug 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:43.587369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:43.589052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.615709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:43.702970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fb96c-01ae-4853-aab2-2538c895c60f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:43.776431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:43.776957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.777233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.777756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.779414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.854977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:43.891438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:43.893183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d960-829c-48dc-a243-feb682caf578 service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:43.912718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 709/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:44.784601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0f69-fad0-45a9-928b-94ddfcbc5255 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:44.785092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0f69-fad0-45a9-928b-94ddfcbc5255 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:44.785188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0f69-fad0-45a9-928b-94ddfcbc5255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:44.870853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-423d0f69-fad0-45a9-928b-94ddfcbc5255 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:44.872054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-423d0f69-fad0-45a9-928b-94ddfcbc5255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:44.977025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 688/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:02:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:45.024809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.025324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.025426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.026850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 710/1398] 10.222.0.67 () {54 vars in 943 bytes} [Wed Aug 3 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:45.034344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329c46-5947-49bc-b07b-ba1cc566616b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.034628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329c46-5947-49bc-b07b-ba1cc566616b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.034926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26329c46-5947-49bc-b07b-ba1cc566616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.093517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.113321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-26329c46-5947-49bc-b07b-ba1cc566616b None None] MFA Rules not processed for user `57923b067b6e441ea8d516d830cdf7de`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:45.114533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26329c46-5947-49bc-b07b-ba1cc566616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:45.227697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 689/1399] 10.222.0.67 () {58 vars in 1040 bytes} [Wed Aug 3 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:45.237957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:45.239792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:45.379311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04738a17-4a47-4d89-be23-edf7809cb341 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:45.420259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.483703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:45.484230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.484528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.484801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.486504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:45.506518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea59de-0b75-495a-b9c2-cdf2218a7eed None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.506846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea59de-0b75-495a-b9c2-cdf2218a7eed None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.507131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea59de-0b75-495a-b9c2-cdf2218a7eed None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.508505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 690/1400] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:02:45.513632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319aaf-a72a-47fb-90a3-568a5db9802a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.513922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319aaf-a72a-47fb-90a3-568a5db9802a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.514204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97319aaf-a72a-47fb-90a3-568a5db9802a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.570727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:45.572406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:45.581335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 711/1401] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:02:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:02:45.582821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-97319aaf-a72a-47fb-90a3-568a5db9802a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:45.584054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-97319aaf-a72a-47fb-90a3-568a5db9802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:45.643501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.685336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 691/1402] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:45.731051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:45.732275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:45.801287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:45.824356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab1ae4-df00-4e9e-9856-f4117e984538 service swift] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:45.939094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:45.940349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:45.940628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:45.940900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:45.942529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:46.053439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:46.055020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750344-ccda-4364-8f20-f7756dfa3add service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:46.060540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:46.074778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 712/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:48.239577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:48.240185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:48.240185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:48.241544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 692/1404] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:48.246941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e989f8-9a52-4c8c-afea-8d7744ac87de None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:48.247373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e989f8-9a52-4c8c-afea-8d7744ac87de None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:48.247488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e989f8-9a52-4c8c-afea-8d7744ac87de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:48.321753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-02e989f8-9a52-4c8c-afea-8d7744ac87de None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:48.323048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-02e989f8-9a52-4c8c-afea-8d7744ac87de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:48.440638 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 713/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:48.485663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:48.487996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:48.659625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daf5ee-d4d0-4439-96b3-f3a5d3e1d25b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:48.710395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:48.791686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:48.792311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:48.792590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:48.792870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:48.794498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:48.899771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:48.901344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7064af-d976-4605-ad3d-e5751763f79b service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:48.923193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 693/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:51.245723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:51.246299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:51.246299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:51.247696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 714/1407] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:02:51.253722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146b7a-0114-4fab-9a5c-89290501a7e3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:51.254136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146b7a-0114-4fab-9a5c-89290501a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:51.254303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc146b7a-0114-4fab-9a5c-89290501a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:51.321399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:51.329083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dc146b7a-0114-4fab-9a5c-89290501a7e3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:51.331121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dc146b7a-0114-4fab-9a5c-89290501a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:51.440701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 694/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:51.486566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:51.488214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:51.568371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:51.646690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5fd85-99c0-4ec3-a171-04f1f4c18743 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:51.789908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:51.790565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:51.790877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:51.791153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:51.792786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:51.832236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:51.900336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:51.902799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d64436-6d4e-4a31-8da2-15c8ae3db935 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:51.926367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 715/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:01.438018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=44 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:01.929887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=31 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:09.137420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac6ba-f47c-41d3-bebb-faab423a0739 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:09.137959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac6ba-f47c-41d3-bebb-faab423a0739 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:09.137959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac6ba-f47c-41d3-bebb-faab423a0739 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:09.139363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 695/1410] 10.222.0.67 () {54 vars in 918 bytes} [Wed Aug 3 13:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:09.144905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11eb8-5d97-43ad-afc2-54483822b071 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:09.145351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11eb8-5d97-43ad-afc2-54483822b071 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:09.145449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11eb8-5d97-43ad-afc2-54483822b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:09.341206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3cb11eb8-5d97-43ad-afc2-54483822b071 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:09.342417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3cb11eb8-5d97-43ad-afc2-54483822b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:09.446655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 716/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Aug 3 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:09.461304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693298e-0060-4f35-8f49-cb4a1080cffe None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:09.461618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693298e-0060-4f35-8f49-cb4a1080cffe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:09.461897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693298e-0060-4f35-8f49-cb4a1080cffe None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:09.463278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 696/1412] 10.222.0.67 () {54 vars in 918 bytes} [Wed Aug 3 13:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:09.467859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63728-371a-444c-8249-349f69a493d0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:09.468144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63728-371a-444c-8249-349f69a493d0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:09.468446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63728-371a-444c-8249-349f69a493d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:09.539659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:09.542209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2be63728-371a-444c-8249-349f69a493d0 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:09.543452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2be63728-371a-444c-8249-349f69a493d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:09.655695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 717/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Aug 3 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:12.103184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:12.103720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:12.103720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:12.105085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:12.110253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68e98-3714-4808-aeda-82c5bd0519c7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:12.111271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68e98-3714-4808-aeda-82c5bd0519c7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:12.111611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b68e98-3714-4808-aeda-82c5bd0519c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:12.179639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d1b68e98-3714-4808-aeda-82c5bd0519c7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:12.180831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d1b68e98-3714-4808-aeda-82c5bd0519c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:12.234666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:12.275814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:12.319169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:12.320713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:12.465928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d400e5-a0b9-48ab-aa18-bafebb1f00c6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:12.538880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:12.578964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:12.580334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:12.580615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:12.580885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:12.582493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:12.671123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:12.672726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e193416-2104-42cd-88ae-776015bed494 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:12.690905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 698/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:13.591973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:13.592560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:13.592560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:13.593954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:13.598974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb318d-cc97-4860-bb18-577a6045896b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:13.599427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb318d-cc97-4860-bb18-577a6045896b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:13.599526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb318d-cc97-4860-bb18-577a6045896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:13.675993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cdcb318d-cc97-4860-bb18-577a6045896b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:13.677197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cdcb318d-cc97-4860-bb18-577a6045896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:13.708061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:13.779280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:13.931752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:13.933214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:14.077378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c48a4-7e8a-4406-bc64-d11380ad59b1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:14.117564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:14.190053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:14.190620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:14.190921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:14.191193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:14.192811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:14.280305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:14.281909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c0bc-ded4-47dc-94b0-711980d2940d service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:14.300632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 720/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:15.191389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:15.191928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:15.191928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:15.193328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:15.198122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888202c9-2b84-4f79-a007-6a73232790e7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:15.198506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888202c9-2b84-4f79-a007-6a73232790e7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:15.198702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888202c9-2b84-4f79-a007-6a73232790e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:15.252760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:15.275274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-888202c9-2b84-4f79-a007-6a73232790e7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:15.276537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-888202c9-2b84-4f79-a007-6a73232790e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:15.371990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:15.525704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:15.527486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:15.674586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0cf5a-3674-4d32-84bc-7363fed4eae2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:15.686692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:15.788647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:15.789264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:15.789543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:15.789818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:15.791473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:15.879814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:15.881395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739fdf-b4a3-4732-958b-87625ea52194 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:15.899850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 701/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:16.759121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:16.759671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:16.759671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:16.761038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:16.765850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed28d5-0f82-494a-8efe-534170a88b4b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:16.766284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed28d5-0f82-494a-8efe-534170a88b4b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:16.766452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed28d5-0f82-494a-8efe-534170a88b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:16.787087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:16.841806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d1ed28d5-0f82-494a-8efe-534170a88b4b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:16.843041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d1ed28d5-0f82-494a-8efe-534170a88b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:16.942602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:17.092351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:17.093910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:17.201416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:17.237514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e06ed-dbaf-40ac-a650-694f83eb8b4b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:17.348179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:17.348788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:17.349063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:17.349334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:17.350973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:17.425649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:17.438849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:17.440516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c57b7d-be6b-4e8d-a056-caaafa9063bd service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:17.458644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 723/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:18.318151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:18.318792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:18.318792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:18.320133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:18.324954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521df3-b773-4e01-b14c-0678c52e168a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:18.325363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521df3-b773-4e01-b14c-0678c52e168a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:18.325521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9521df3-b773-4e01-b14c-0678c52e168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:18.401321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c9521df3-b773-4e01-b14c-0678c52e168a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:18.402738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c9521df3-b773-4e01-b14c-0678c52e168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:18.502921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:18.654155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:18.655689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:18.741458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:18.804595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea451449-adcb-41e0-91e9-8ab110e32ac3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:18.917201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:18.917735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:18.918010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:18.918284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:18.919928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:18.968886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:19.010705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:19.012358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f591-4173-4cf9-a904-30e1deffcb78 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:19.030983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 704/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:19.895772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:19.896312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:19.896312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:19.897624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:19.902823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717941-5bc9-4e88-b5e7-6f4b6cc2a19e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:19.903251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717941-5bc9-4e88-b5e7-6f4b6cc2a19e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:19.903420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717941-5bc9-4e88-b5e7-6f4b6cc2a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:19.980045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8b717941-5bc9-4e88-b5e7-6f4b6cc2a19e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:19.981270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8b717941-5bc9-4e88-b5e7-6f4b6cc2a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:20.079780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:20.228818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:20.230248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:20.278155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:20.374075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13dad2-16e9-4de0-ab60-33765de75794 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:20.485688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:20.485688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:20.486001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:20.486001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:20.487653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:20.494800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:20.576435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:20.578039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3764c-111a-4744-875a-96d91beb9451 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:20.596751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 726/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:21.460096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.460548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.460663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.462053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:21.467083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203319-89b2-43e1-9863-fd964f988181 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.467485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203319-89b2-43e1-9863-fd964f988181 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.467664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203319-89b2-43e1-9863-fd964f988181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.543853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-82203319-89b2-43e1-9863-fd964f988181 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:21.545073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-82203319-89b2-43e1-9863-fd964f988181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.611399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:21.639712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:21.789954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:21.791512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.811086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:21.941454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876e0ce-c927-4727-afb6-78d1ecfc2e0c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:22.027983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:22.054227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:22.054807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.055089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.055362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.056970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.146130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:22.147777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31d51-489e-4529-ba5c-cdd098987c4f service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:22.166570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 707/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:23.025402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.025934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.025934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.027711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:23.036342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0ffc7-779e-4987-a707-c3a44c96dc60 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.036342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0ffc7-779e-4987-a707-c3a44c96dc60 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.036342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0ffc7-779e-4987-a707-c3a44c96dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.111266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-19f0ffc7-779e-4987-a707-c3a44c96dc60 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:23.112472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-19f0ffc7-779e-4987-a707-c3a44c96dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:23.155451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:23.210405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:23.362465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:23.364017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:23.507095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d04c08-a3ec-440f-8efb-14db151ea54d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:23.560388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:23.618214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:23.618852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:23.619134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:23.619407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:23.621021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:23.708448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:23.710047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9b04-1e4c-4b85-a854-0ea21ec73f05 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:23.727801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 729/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:24.601945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.602470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.602470 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.604604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:24.608873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0ec1-645a-4322-9e85-32b54343d272 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:24.609302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0ec1-645a-4322-9e85-32b54343d272 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:24.609399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0ec1-645a-4322-9e85-32b54343d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:24.687214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e86a0ec1-645a-4322-9e85-32b54343d272 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:24.689087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e86a0ec1-645a-4322-9e85-32b54343d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:24.691231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:24.785005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:24.936231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:24.937736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.086585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951540f-ca14-4ff8-b62b-b7c49fbfdbea None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:25.114518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:25.201811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:25.202345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:25.202620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:25.202920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:25.204794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:25.293911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:25.295587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcf0c3-72f6-40da-9409-6452aedeb734 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:25.314126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 710/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:27.209707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:27.210245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:27.210245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:27.211659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:27.216813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222db54-9b48-449a-9206-7bf08115bedb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:27.217267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222db54-9b48-449a-9206-7bf08115bedb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:27.217367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222db54-9b48-449a-9206-7bf08115bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:27.260191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:27.285400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f222db54-9b48-449a-9206-7bf08115bedb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:27.286599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f222db54-9b48-449a-9206-7bf08115bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:27.384088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:27.423463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:27.424984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:27.526236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3870f-ebca-4a84-8a92-688473219983 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:27.557474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:27.599326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:27.599934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:27.600213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:27.600482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:27.602080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:27.708146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:27.709586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeb4b5-0157-421f-b5cc-e12fe88dd0bd service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:27.727838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 732/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:29.879102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:29.879668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:29.879668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:29.881029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:29.886291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2a6-82a3-4435-b859-3f1b1450b70a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:29.886671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2a6-82a3-4435-b859-3f1b1450b70a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:29.886869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2a6-82a3-4435-b859-3f1b1450b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:29.954585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6960d2a6-82a3-4435-b859-3f1b1450b70a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:29.956089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6960d2a6-82a3-4435-b859-3f1b1450b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:29.968459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:30.055843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:30.093552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:30.095747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:30.196802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f811075-93c3-476d-b388-0e7ebf4d39ec None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:30.209335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:30.271220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:30.271836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:30.272116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:30.272390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:30.274019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:30.384505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:30.385985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274df7b-c912-40ce-8339-348e9658a040 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:30.404816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 713/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:32.790584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:32.791159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:32.791159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:32.792515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:32.797644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06f53-8afb-45a9-a3b1-36e01ef21699 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:32.798186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06f53-8afb-45a9-a3b1-36e01ef21699 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:32.798281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06f53-8afb-45a9-a3b1-36e01ef21699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:32.847037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:32.864877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-61a06f53-8afb-45a9-a3b1-36e01ef21699 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:32.866011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-61a06f53-8afb-45a9-a3b1-36e01ef21699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:32.962599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:33.007757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:33.009365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:33.111455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c1d74-31db-4fc4-8649-9fb8a4da2e9e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:33.151562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:33.185166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:33.185960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:33.186461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:33.187070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:33.188812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:33.295208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:33.296638 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580011-d67e-4597-b2de-de8ec63059ad service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:33.315647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 735/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:35.435160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:35.435733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:35.435733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:35.437064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:35.442249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832efe3-0795-4ca2-a439-f1cfb5669a6a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:35.442667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832efe3-0795-4ca2-a439-f1cfb5669a6a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:35.442861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832efe3-0795-4ca2-a439-f1cfb5669a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:35.508268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c832efe3-0795-4ca2-a439-f1cfb5669a6a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:35.509481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c832efe3-0795-4ca2-a439-f1cfb5669a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:35.530119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:35.605450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:35.644220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:35.645754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:35.753275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1bc5-4245-466a-8c6b-a1166955257e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:35.773248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:35.826875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:35.827485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:35.827757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:35.828024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:35.830252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:35.939865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:35.941310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fa24d-6842-4f6c-8341-bdf6d85c75a5 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:35.959162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 716/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:38.008322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:38.008836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:38.008836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:38.010146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:38.015328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e45e-de8c-4ad9-a44d-fe4ada322c20 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:38.015740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e45e-de8c-4ad9-a44d-fe4ada322c20 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:38.015888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e45e-de8c-4ad9-a44d-fe4ada322c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:38.080122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:38.082940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bc16e45e-de8c-4ad9-a44d-fe4ada322c20 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:38.084197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bc16e45e-de8c-4ad9-a44d-fe4ada322c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:38.183645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:38.222274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:38.223903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:38.326840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449072e-d480-4564-abdb-80b472a3f46c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:38.375306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:38.401252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:38.402174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:38.402452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:38.402734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:38.404371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:38.518454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:38.519920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2b4c3-325b-455e-b9b2-a8207477c61c service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:38.538858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 738/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:41.005172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:41.005743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:41.005743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:41.007104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:41.012387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75287-2e00-4f6d-9560-75224add3a6a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:41.012884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75287-2e00-4f6d-9560-75224add3a6a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:41.012994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75287-2e00-4f6d-9560-75224add3a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:41.078229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-69c75287-2e00-4f6d-9560-75224add3a6a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:41.080056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-69c75287-2e00-4f6d-9560-75224add3a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:41.108449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:41.177031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:41.215045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:41.216572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:41.319050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad12e2-8e1b-4394-b7e9-09a4b58fb654 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:41.348612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:41.395290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:41.396003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:41.396286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:41.396559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:41.398172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:41.507172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:41.508616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c9dc-01ad-4e29-b1a4-764cc0f4ccc7 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:41.527719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 719/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:43.565356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.565902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.565902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.567305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:43.572587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ede6-b83f-45f7-920e-edf42a32a62e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.573037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ede6-b83f-45f7-920e-edf42a32a62e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.573144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050ede6-b83f-45f7-920e-edf42a32a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.640550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e050ede6-b83f-45f7-920e-edf42a32a62e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:43.642367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e050ede6-b83f-45f7-920e-edf42a32a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:43.650622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:43.740869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:43.778923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:43.780455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:43.882233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9482f94-2984-45dc-9d04-5d4e8afd071f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:43.936650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:43.955536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:43.956151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.956429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.956699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.958309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:44.065050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:44.066485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c500788-065a-4012-b67c-41c6ee25379f service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:44.085173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 741/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:46.108592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:46.109134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:46.109134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:46.110505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:46.115821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7610-7c02-4c5b-b445-ef04e1da118f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:46.116280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7610-7c02-4c5b-b445-ef04e1da118f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:46.116380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7610-7c02-4c5b-b445-ef04e1da118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:46.183700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-db3e7610-7c02-4c5b-b445-ef04e1da118f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:46.184898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-db3e7610-7c02-4c5b-b445-ef04e1da118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:46.223967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:46.282363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:46.319459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:46.321002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:46.425092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf42b1-64fc-47d8-bfb3-b2eee5550315 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:46.462262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:46.498103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:46.498732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:46.499026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:46.499302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:46.501473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:46.733116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:46.734561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c62e6-a97b-45c5-b9f7-f2a3e1182498 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:46.753794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 722/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:48.759273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.759838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.759838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.761227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:03:48.767391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2e194-13b8-4a34-9848-9da6d5d0fc65 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:48.767831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2e194-13b8-4a34-9848-9da6d5d0fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:48.767936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2e194-13b8-4a34-9848-9da6d5d0fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:48.832538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f8b2e194-13b8-4a34-9848-9da6d5d0fc65 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:48.833734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f8b2e194-13b8-4a34-9848-9da6d5d0fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:48.851771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:48.929679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:48.966403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:48.967987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:49.073367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eab2f-9954-441c-a39f-45a724356ab1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:49.139831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:49.147392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:49.147998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:49.148273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:49.148550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:49.150222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:49.257647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:49.259049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce519db-fcd2-4488-a4c7-409fbd3fb7bc service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:49.278389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 744/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:51.298892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:51.299444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:51.299444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:51.300825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:03:51.306139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1184f-dfa4-4ecf-89ab-b2e2289df9c4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:51.306542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1184f-dfa4-4ecf-89ab-b2e2289df9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:51.306687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1184f-dfa4-4ecf-89ab-b2e2289df9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:51.371966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5ab1184f-dfa4-4ecf-89ab-b2e2289df9c4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:51.373167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5ab1184f-dfa4-4ecf-89ab-b2e2289df9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:51.420920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:51.469276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:51.505931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:51.507492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:51.610848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02304-6115-40e1-b191-a81c154c7a92 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:51.657818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:51.683647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:51.684281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:51.684570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:51.684844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:51.687303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:51.795307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:51.796737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b583a91-92e2-40f0-a17b-978cedbe7ebf service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:51.816290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 725/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:01.467438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=22 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:01.813636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:11.369229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab2fd-0b10-49ae-b4f3-1a4a6e928e33 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.369804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab2fd-0b10-49ae-b4f3-1a4a6e928e33 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.369804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab2fd-0b10-49ae-b4f3-1a4a6e928e33 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.371207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 746/1471] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:11.376999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550e87-68dc-455c-b243-82fa8b3eaf5e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.377445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550e87-68dc-455c-b243-82fa8b3eaf5e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.377562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4550e87-68dc-455c-b243-82fa8b3eaf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.441702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b4550e87-68dc-455c-b243-82fa8b3eaf5e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:11.442911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b4550e87-68dc-455c-b243-82fa8b3eaf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.537051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 726/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:11.620164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.620391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.620665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.622008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 747/1473] 10.222.0.67 () {54 vars in 966 bytes} [Wed Aug 3 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:11.627693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194f62-6d4d-4459-8e1e-39dba269868b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.627979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194f62-6d4d-4459-8e1e-39dba269868b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.628253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65194f62-6d4d-4459-8e1e-39dba269868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.703087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-65194f62-6d4d-4459-8e1e-39dba269868b None None] MFA Rules not processed for user `6485a82c946346f9b0a53a87056116ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:11.704281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-65194f62-6d4d-4459-8e1e-39dba269868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.725565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:11.781334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 727/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Aug 3 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:11.788957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.790509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.893100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bf84d-cb75-4556-a88e-b826cf116e52 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.964659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.965272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.965552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.965825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.967495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:12.020944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:12.075952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:12.077392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de912dd-6beb-4f46-b737-2f3c01503d5f service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:12.095634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 748/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:14.177745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:14.178285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:14.178285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:14.179701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 728/1476] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:14.184769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b75bc-5cd5-402a-ad08-fa1871def194 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:14.185202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b75bc-5cd5-402a-ad08-fa1871def194 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:14.185311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b75bc-5cd5-402a-ad08-fa1871def194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:14.249918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a24b75bc-5cd5-402a-ad08-fa1871def194 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:14.251154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a24b75bc-5cd5-402a-ad08-fa1871def194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:14.349128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 749/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:14.372296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:14.373821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:14.500832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d97e7-0d7b-4372-b850-2892ef343ca5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:14.550969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:14.595555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:14.596175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:14.596455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:14.596730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:14.597418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:14.599188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:04:14.599188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:04:14.599188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:04:14.600331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ebde5-4471-48e3-8c76-16f34b3ff018 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:14.618830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 729/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Aug 3 13:04:14 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:04:16.612691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:16.613230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:16.613230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:16.614583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 750/1479] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:16.619727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fdc-0850-4ecd-8658-6121a873bacd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:16.620154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fdc-0850-4ecd-8658-6121a873bacd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:16.620262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fdc-0850-4ecd-8658-6121a873bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:16.685623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-47606fdc-0850-4ecd-8658-6121a873bacd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:16.686864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-47606fdc-0850-4ecd-8658-6121a873bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:16.783031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 730/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:16.826084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:16.827626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:16.837828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:16.971244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9b184-2838-4403-bb19-5bae586e41da None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:17.048848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:17.081414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:17.082023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:17.082302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:17.082573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:17.084221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:17.170490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:17.172098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e338b7-67f3-4d64-bfcc-969655164a8c service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:17.191720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 751/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:19.357206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:19.357788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:19.357788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:19.359138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 731/1482] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:19.365126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cecd-298b-44d6-9b7c-f16085f68e5b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:19.365600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cecd-298b-44d6-9b7c-f16085f68e5b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:19.365722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cecd-298b-44d6-9b7c-f16085f68e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:19.431312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0dc8cecd-298b-44d6-9b7c-f16085f68e5b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:19.432532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0dc8cecd-298b-44d6-9b7c-f16085f68e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:19.478623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:19.531571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 752/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:19.569415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:19.571022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:19.594403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:19.674532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5aba-18d8-4f1e-b543-0cd62480ed7a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:19.748405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:19.749020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:19.749296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:19.749566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:19.751336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:19.825381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:19.859315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:19.861400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935bd24-198f-4850-8e35-fbaf2058fe6d service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:19.879467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 732/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:21.959805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:21.960388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:21.960388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:21.961713 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 753/1485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:21.966828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15295d-4a53-4e1a-9088-e161024c5e91 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:21.967233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15295d-4a53-4e1a-9088-e161024c5e91 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:21.967378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15295d-4a53-4e1a-9088-e161024c5e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:22.034649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9d15295d-4a53-4e1a-9088-e161024c5e91 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:22.035880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9d15295d-4a53-4e1a-9088-e161024c5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:22.132547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 733/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:22.171011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:22.172603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:22.275291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc3539-0ee1-4f71-89af-08739bfe84b8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:22.347858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:22.349644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:22.350258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:22.350540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:22.350847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:22.352479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:22.461040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:22.462414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710f12-6057-497b-98bc-d8c37f9d9e07 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:22.481814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 754/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:24.680354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:24.680825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:24.680951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:24.682305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 734/1488] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:24.687741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff2a6-96a4-428e-98c4-07d7202b889e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:24.688189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff2a6-96a4-428e-98c4-07d7202b889e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:24.688307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff2a6-96a4-428e-98c4-07d7202b889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:24.753778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cd8ff2a6-96a4-428e-98c4-07d7202b889e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:24.755014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cd8ff2a6-96a4-428e-98c4-07d7202b889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:24.807569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:24.858522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 755/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:24.900285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:24.902412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:24.940693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:25.008437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd2eaa-102b-476c-932b-f43941f309f6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:25.082789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:25.083401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:25.083701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:25.083971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:25.085576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:25.164991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:25.196255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:25.197690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea1c6-596c-4739-a0cb-522bf287bb76 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:25.216254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 735/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:04:27.599350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:27.599930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:27.599930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:27.601291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 756/1491] 10.222.0.67 () {54 vars in 926 bytes} [Wed Aug 3 13:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:04:27.606653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34cd-5a93-47b1-adba-1eb4eca8c34b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:27.607098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34cd-5a93-47b1-adba-1eb4eca8c34b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:27.607215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da34cd-5a93-47b1-adba-1eb4eca8c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:27.672775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c2da34cd-5a93-47b1-adba-1eb4eca8c34b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:04:27.673952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c2da34cd-5a93-47b1-adba-1eb4eca8c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:27.769326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 736/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Aug 3 13:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:04:27.808910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:27.810448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:27.913280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdd031-0ca9-4012-a7a6-fe3711fe5a11 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:27.984919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:27.985562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:27.985838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:27.986113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:27.987762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:27.996818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:28.095919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:28.097360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe5ae1-8bca-40bb-9a0d-ec42461130c2 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:28.114795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 757/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:37.766903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=82 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:38.112485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=50 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:24.759919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:24.760433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:24.760534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:24.840210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:24.841328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:24.947365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 737/1494] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:06:24.955588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:24.961643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:24.961643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:24.976363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:24.977546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:24.987231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 758/1495] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:06:24.991861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.001572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bbbf7-e704-469c-a703-e79c45373948 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.006246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.007508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.007799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.008238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.008938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:06:25.009242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.010259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.010259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:06:25.010259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:06:25.011178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.023486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 738/1496] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:06:25.031970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.041370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c57b9a-8b7d-4ef4-8d83-eec839ca6683 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.045982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.046586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.046895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.047170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.047835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.049551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.049551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:06:25.049551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:06:25.050779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.166993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 759/1497] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:06:25 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:06:25.171197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.182031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae6933-540d-43f3-b1cf-31ae424b42e0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.230582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:25.237052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.237704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.237987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.238263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.238961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.242999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.242999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:06:25.242999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:06:25.242999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.337599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 739/1498] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:06:25 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:06:25.341663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.352307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157613-785c-4257-9f52-fc7a8c5eb7a7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.356964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.357563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.357961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.358240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.358990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.359994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.359994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:06:25.359994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:06:25.360883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.374187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 760/1499] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:06:25.379363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.390644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f69d4d-bc01-4788-a05a-cf031b631167 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.395581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.396196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.396475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.396773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.397573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.398785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.398785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:06:25.398785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:06:25.399684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb26ec-d77c-4a29-95ca-165a1e64be43 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.413509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 740/1500] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:06:25.418387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.428273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc74a8-49f4-4626-801d-b0e8c04feb06 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.433612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.434256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.434534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.434838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] PATH_INFO: `/v3/projects/fa5d975304fd4d1b932de6dd676e63f9/users/4502a227c66d4f6d804a379a0a98f610/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.450098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5d975304fd4d1b932de6dd676e63f9, user_id=4502a227c66d4f6d804a379a0a98f610, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.451145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.451145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:06:25.451145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:06:25.453083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cdbe-dd7e-497c-be41-cc49dbb6c0a7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.564122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 761/1501] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:06:25 2022] PUT /identity/v3/projects/fa5d975304fd4d1b932de6dd676e63f9/users/4502a227c66d4f6d804a379a0a98f610/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:06:25.576458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e027252-d81f-4112-9924-bdc73fbd654a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.580776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e027252-d81f-4112-9924-bdc73fbd654a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.580776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e027252-d81f-4112-9924-bdc73fbd654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.606055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6e027252-d81f-4112-9924-bdc73fbd654a None None] MFA Rules not processed for user `4502a227c66d4f6d804a379a0a98f610`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:25.609779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6e027252-d81f-4112-9924-bdc73fbd654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:25.671191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 741/1502] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:06:25.684658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4137-6171-46d6-a907-ffff2ccd8e91 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.684941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4137-6171-46d6-a907-ffff2ccd8e91 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.685217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4137-6171-46d6-a907-ffff2ccd8e91 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.686578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 762/1503] 10.222.0.67 () {54 vars in 964 bytes} [Wed Aug 3 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:06:25.691823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88fa-91b4-48a8-ace8-2d589dbba356 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.692114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88fa-91b4-48a8-ace8-2d589dbba356 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.692389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad88fa-91b4-48a8-ace8-2d589dbba356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.753542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-88ad88fa-91b4-48a8-ace8-2d589dbba356 None None] MFA Rules not processed for user `e31fc272e5f24eac95630f0fced91df6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:25.754782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-88ad88fa-91b4-48a8-ace8-2d589dbba356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:25.829002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 742/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Aug 3 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:06:25.837502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca4137-6171-46d6-a907-ffff2ccd8e91 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.847847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca4137-6171-46d6-a907-ffff2ccd8e91 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.852170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.852765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.853046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.853306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.861335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.862854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:25.871812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 763/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:06:25.917625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5201c13-3975-4b07-a4ad-3eb463dd17da None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.917913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5201c13-3975-4b07-a4ad-3eb463dd17da None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.918192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5201c13-3975-4b07-a4ad-3eb463dd17da None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.919531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 743/1506] 10.222.0.67 () {52 vars in 830 bytes} [Wed Aug 3 13:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:06:25.923413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:25.985475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4ed59-5dd7-43b7-9f97-47cb1fb4e456 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:25.990321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:25.990997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:25.991315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:25.991588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] PATH_INFO: `/v3/users/4502a227c66d4f6d804a379a0a98f610` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:25.992816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4502a227c66d4f6d804a379a0a98f610)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:25.993813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:25.993813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:06:25.993813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:06:25.995128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:26.279069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4502a227c66d4f6d804a379a0a98f610'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:26.279719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4502a227c66d4f6d804a379a0a98f610'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:26.280330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4502a227c66d4f6d804a379a0a98f610'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:26.302685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4502a227c66d4f6d804a379a0a98f610'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:26.364067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4502a227c66d4f6d804a379a0a98f610'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:26.375134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:26.385130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 764/1507] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:06:25 2022] DELETE /identity/v3/users/4502a227c66d4f6d804a379a0a98f610 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:06:26.389748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:26.390059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:26.390333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:26.409741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:06:26.414704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:26.419989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:26.469041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 744/1508] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:06:26.479427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:26.480930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:26.557553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6ee6-c012-4111-8c83-2f335b99e214 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:26.561300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:26.561922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:26.562207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:26.562482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:26.572501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:26.573943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556522-71fa-4f76-ad8f-b1f3abc136d5 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:26.583599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 765/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:06:27.091407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:06:27.092845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:06:27.106419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899387d-15ef-4edb-ad82-181693ebdcf1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:06:27.111108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:06:27.111752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:06:27.112035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:06:27.112309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] PATH_INFO: `/v3/projects/fa5d975304fd4d1b932de6dd676e63f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:06:27.113562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5d975304fd4d1b932de6dd676e63f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:06:27.114500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:06:27.114500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:06:27.114500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:06:27.115707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:06:27.248649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5d975304fd4d1b932de6dd676e63f9', 'request_id': 'req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:27.262228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5d975304fd4d1b932de6dd676e63f9', 'request_id': 'req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:27.272106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5d975304fd4d1b932de6dd676e63f9', 'request_id': 'req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:27.372118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] The token cache is being invalidate because project fa5d975304fd4d1b932de6dd676e63f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:06:27.372363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:27.373161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0b9912d8-a470-4c6a-8b1d-1e9c306ba4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:06:27.374781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 745/1510] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:06:27 2022] DELETE /identity/v3/projects/fa5d975304fd4d1b932de6dd676e63f9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:06:36.579781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=38 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:06:37.368751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:19.625194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:19.625782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:19.625782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:19.627144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:19.631977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbb99-0a21-4904-ae84-3b055f68d8c5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:19.632406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbb99-0a21-4904-ae84-3b055f68d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:19.632568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbb99-0a21-4904-ae84-3b055f68d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:19.652157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3d4dbb99-0a21-4904-ae84-3b055f68d8c5 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:19.653368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3d4dbb99-0a21-4904-ae84-3b055f68d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:19.714085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:19.867008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:19.868945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:19.971588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e21a-a30c-42d2-8dfc-ae05ab19f381 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:19.977043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:19.977842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:19.978137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:19.978417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:19.986470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:19.988086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c212-e30d-43b9-9aa3-9d3eb050c8c6 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:19.998149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 767/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:20.819415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd8cc-a9f4-4baa-91ee-7773af3ea533 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:20.819947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd8cc-a9f4-4baa-91ee-7773af3ea533 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:20.820071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd8cc-a9f4-4baa-91ee-7773af3ea533 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:20.821375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:08:20.826536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f41a0-8243-4c54-98b8-9b823a0d0b34 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:20.826997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f41a0-8243-4c54-98b8-9b823a0d0b34 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:20.827100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f41a0-8243-4c54-98b8-9b823a0d0b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:20.849249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9e4f41a0-8243-4c54-98b8-9b823a0d0b34 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:20.850465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e4f41a0-8243-4c54-98b8-9b823a0d0b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:20.858947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:21.011819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefd8cc-a9f4-4baa-91ee-7773af3ea533 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:21.014533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf0c4-10bf-4073-9494-5f7c13643084 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:21.014918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf0c4-10bf-4073-9494-5f7c13643084 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:21.015266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcf0c4-10bf-4073-9494-5f7c13643084 None None] PATH_INFO: `/v3` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:21.016661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 769/1516] 10.222.0.74 () {54 vars in 925 bytes} [Wed Aug 3 13:08:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:08:21.022593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65732-dc0c-4772-b7dc-fd9b7aa1818e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:21.022901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65732-dc0c-4772-b7dc-fd9b7aa1818e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:21.023173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec65732-dc0c-4772-b7dc-fd9b7aa1818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:21.028124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefd8cc-a9f4-4baa-91ee-7773af3ea533 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:21.033555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:21.034162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:21.034439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:21.034730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:21.043358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:21.044952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea8682-4ee2-4003-ba67-c77a26f785da service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:21.054719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 748/1517] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:21.076237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1ec65732-dc0c-4772-b7dc-fd9b7aa1818e None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:21.077487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1ec65732-dc0c-4772-b7dc-fd9b7aa1818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:21.156876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 770/1518] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Aug 3 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:08:30.322700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e68d3-0150-4d71-9de7-0bae1c810fb7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:30.323279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e68d3-0150-4d71-9de7-0bae1c810fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:30.323279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e68d3-0150-4d71-9de7-0bae1c810fb7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:30.324625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 749/1519] 10.222.0.67 () {54 vars in 961 bytes} [Wed Aug 3 13:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:30.329709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed0e-7200-4a86-b21b-9542f10190d0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:30.330165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed0e-7200-4a86-b21b-9542f10190d0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:30.330289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157ed0e-7200-4a86-b21b-9542f10190d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:30.349451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a157ed0e-7200-4a86-b21b-9542f10190d0 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:30.350640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a157ed0e-7200-4a86-b21b-9542f10190d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:30.359330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 771/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Aug 3 13:08:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:30.366841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e68d3-0150-4d71-9de7-0bae1c810fb7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:30.380905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e68d3-0150-4d71-9de7-0bae1c810fb7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:30.386629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:30.387283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:30.387586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:30.387857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:30.396179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:30.397741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572b0e-4416-4251-b732-658d69efd4f7 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:30.407597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 750/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:32.311333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6c38-a7d8-4899-b961-4b8c3b5f964f None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:32.311942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6c38-a7d8-4899-b961-4b8c3b5f964f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:32.311942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e6c38-a7d8-4899-b961-4b8c3b5f964f None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:32.313231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:32.317976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5de8e-db8d-4d02-b0ab-e2177079e8dc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:32.318415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5de8e-db8d-4d02-b0ab-e2177079e8dc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:32.318517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5de8e-db8d-4d02-b0ab-e2177079e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:32.338970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-89b5de8e-db8d-4d02-b0ab-e2177079e8dc None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:32.340181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-89b5de8e-db8d-4d02-b0ab-e2177079e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:32.348067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:32.501637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6c38-a7d8-4899-b961-4b8c3b5f964f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:32.516750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e6c38-a7d8-4899-b961-4b8c3b5f964f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:32.522092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:32.522689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:32.522996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:32.523267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:32.530275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:32.532702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:32.534390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49407-f87c-4239-a68c-7a5192600f6c service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:32.544063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 773/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:33.358620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e2f5-73ce-4aa0-8abd-024659a3d4d4 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:33.359277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e2f5-73ce-4aa0-8abd-024659a3d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:33.359277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1e2f5-73ce-4aa0-8abd-024659a3d4d4 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:33.360534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 13:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:33.365234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a170f-9212-456e-9296-546296d92164 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:33.365632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a170f-9212-456e-9296-546296d92164 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:33.365791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a170f-9212-456e-9296-546296d92164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:33.385961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-413a170f-9212-456e-9296-546296d92164 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:33.387187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-413a170f-9212-456e-9296-546296d92164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:33.394896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 13:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:33.545058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e2f5-73ce-4aa0-8abd-024659a3d4d4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:33.559933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1e2f5-73ce-4aa0-8abd-024659a3d4d4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:33.565427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:33.566023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:33.566322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:33.566589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:33.575634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:33.577207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1743f2f-40d2-4e5c-a538-a2de1699388d service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:33.586338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 753/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:37.488546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:37.489115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:37.489115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:37.490460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:37.496372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c24-608d-4d68-b369-40c33b9894cd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:37.496822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c24-608d-4d68-b369-40c33b9894cd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:37.496929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c24-608d-4d68-b369-40c33b9894cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:37.516525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-10881c24-608d-4d68-b369-40c33b9894cd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:37.517730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-10881c24-608d-4d68-b369-40c33b9894cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:37.526138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:37.598349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:37.600082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:37.657507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3f23-6efc-455d-b725-0832f401d1ff None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:37.661064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:37.661681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:37.661964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:37.662242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:37.671687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:37.673127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c870b-64da-438d-910f-ffb6b692ae94 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:37.682994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 776/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:39.675178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7b42-dcf3-4bc4-be9f-34a3001d5087 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:39.675706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7b42-dcf3-4bc4-be9f-34a3001d5087 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:39.675706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a7b42-dcf3-4bc4-be9f-34a3001d5087 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:39.677039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:39.682551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052f1d-40d9-4cdc-83d8-951343526772 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:39.683014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052f1d-40d9-4cdc-83d8-951343526772 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:39.683119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd052f1d-40d9-4cdc-83d8-951343526772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:39.703054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bd052f1d-40d9-4cdc-83d8-951343526772 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:39.704264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bd052f1d-40d9-4cdc-83d8-951343526772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:39.712845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:39.748528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a7b42-dcf3-4bc4-be9f-34a3001d5087 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:39.759746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a7b42-dcf3-4bc4-be9f-34a3001d5087 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:39.763257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:39.763858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:39.764137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:39.764409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:39.773112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:39.775532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0ad0-4424-4af4-a673-04e393d7856b service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:39.784837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 756/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:43.307492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.308056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.308056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.309398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:43.314499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28e1b-9a0a-4c15-8ee8-8910e0d9dce3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.314966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28e1b-9a0a-4c15-8ee8-8910e0d9dce3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.315100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f28e1b-9a0a-4c15-8ee8-8910e0d9dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.334805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-48f28e1b-9a0a-4c15-8ee8-8910e0d9dce3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:43.336003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-48f28e1b-9a0a-4c15-8ee8-8910e0d9dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:43.344435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:43.647687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:43.649807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:43.706454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f80cff-3a27-4ddd-b5f0-5d36a3d59926 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:43.710014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:43.710629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:43.710946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:43.711221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:43.719962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:43.721392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f2e4c-0064-42af-9273-bdcaf26ab02e service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:43.731154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 779/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:45.776806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.777363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.777363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.778915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 13:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:08:45.784122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947344-bcc2-4fe7-8f26-9ffe6af5f6f8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:45.784564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947344-bcc2-4fe7-8f26-9ffe6af5f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:45.784678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947344-bcc2-4fe7-8f26-9ffe6af5f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:45.804586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-20947344-bcc2-4fe7-8f26-9ffe6af5f6f8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:08:45.805784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-20947344-bcc2-4fe7-8f26-9ffe6af5f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:45.814441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:08:46.116675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:08:46.118357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:08:46.132013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae04fb-0551-43a3-9982-7f67a7582529 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:08:46.136284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:08:46.136893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:08:46.137171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:08:46.137447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:08:46.146496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:08:46.147969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d52a26-c5f6-493b-b88d-3a01a9d90f1e service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:08:46.157943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 759/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:08:55.799287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=63 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:08:56.153664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:22.607556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31381-334b-46bd-9e8c-5703aa7b4500 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.608295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31381-334b-46bd-9e8c-5703aa7b4500 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.608396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f31381-334b-46bd-9e8c-5703aa7b4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.652679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d6f31381-334b-46bd-9e8c-5703aa7b4500 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:22.656593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d6f31381-334b-46bd-9e8c-5703aa7b4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:22.669487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 781/1540] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:22.671187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f17e-24b0-4fc3-99bc-bf0a3e5061fc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.671732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f17e-24b0-4fc3-99bc-bf0a3e5061fc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.671862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f17e-24b0-4fc3-99bc-bf0a3e5061fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.688438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.688438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.688438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.728920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:22.730121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8492f17e-24b0-4fc3-99bc-bf0a3e5061fc None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:22.730427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:22.740767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8492f17e-24b0-4fc3-99bc-bf0a3e5061fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:22.746508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 782/1541] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:22.751646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:22.765321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 760/1542] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:22.766235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e8290-d747-40b3-b01c-7bfbab61b393 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:22.776256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:22.777038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.777458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.777639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.778624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:22.779040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:22.780483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:22.780483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:10:22.780483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:10:22.781593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:22.785157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.785441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.785721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.824632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 783/1543] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:10:22.836993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:22.848005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:22.849444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:22.852677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a885a3-5911-4bf3-be01-d14439b7f7db admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:22.862445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:22.863041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.863419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.863699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.867160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:22.869512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:22.887889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 761/1544] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:22.895753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:22.915831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7493bb-22a2-429d-964d-08feb9050505 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:22.921627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:22.926045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ea53e-ea23-459c-8b9c-b51f11e41683 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:22.942811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 762/1545] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:22.944450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbaed-8c1a-40c9-9a88-13c781d027be None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.944782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbaed-8c1a-40c9-9a88-13c781d027be None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.945061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cbaed-8c1a-40c9-9a88-13c781d027be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.970010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f33cbaed-8c1a-40c9-9a88-13c781d027be None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:22.971321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f33cbaed-8c1a-40c9-9a88-13c781d027be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:22.980245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 763/1546] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:22.981488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92f0b-df02-440f-9009-998827d12add None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:22.981838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92f0b-df02-440f-9009-998827d12add None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:22.982741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92f0b-df02-440f-9009-998827d12add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:22.991560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 784/1547] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:10:23.000695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.024003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fee92f0b-df02-440f-9009-998827d12add None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.025768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fee92f0b-df02-440f-9009-998827d12add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.087117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9635a-72ba-469c-86a3-c402a3bc659c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.092105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.092720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.092995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.093271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.093926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.096025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e890a-0fdd-4017-85bd-f148d464d9ac admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.099780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 764/1548] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.100614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92f0b-df02-440f-9009-998827d12add None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.113076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92f0b-df02-440f-9009-998827d12add None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.117723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.118348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.118625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.118929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.119595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.121528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d78d1-b436-47e6-9efa-873363439c07 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.248248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 785/1549] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:22 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:23.248248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4eec-258e-498c-a1fd-8a703d03cbcb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.248248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4eec-258e-498c-a1fd-8a703d03cbcb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.248248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a4eec-258e-498c-a1fd-8a703d03cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.267278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-766a4eec-258e-498c-a1fd-8a703d03cbcb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.270846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 765/1550] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:23.271004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-766a4eec-258e-498c-a1fd-8a703d03cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.271105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc672389-dd21-4c10-a5a6-f70e933c4667 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.271105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc672389-dd21-4c10-a5a6-f70e933c4667 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.271105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc672389-dd21-4c10-a5a6-f70e933c4667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.290195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cc672389-dd21-4c10-a5a6-f70e933c4667 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.291422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cc672389-dd21-4c10-a5a6-f70e933c4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.331022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 786/1551] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.335866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7b08-5d6d-4186-aaaa-afcb13314b75 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.336187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7b08-5d6d-4186-aaaa-afcb13314b75 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.336468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd7b08-5d6d-4186-aaaa-afcb13314b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.351016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 766/1552] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.352301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdea6f-8a2c-465e-9766-15831c03c7bb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.352577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdea6f-8a2c-465e-9766-15831c03c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.352853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdea6f-8a2c-465e-9766-15831c03c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.357084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b9cd7b08-5d6d-4186-aaaa-afcb13314b75 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.358613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b9cd7b08-5d6d-4186-aaaa-afcb13314b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.366757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 787/1553] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.367920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.368235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.368554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.375298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-03bdea6f-8a2c-465e-9766-15831c03c7bb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.378558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-03bdea6f-8a2c-465e-9766-15831c03c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.384690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 767/1554] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.385934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.386221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.386494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.399310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.400545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.407824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.408834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 788/1555] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.408994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.409597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.417800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 768/1556] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.418664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.420324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a8c4-8faa-4bdf-b8b1-78d2f1b50dbc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.425027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.425656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.425938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.426213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.426901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.427911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:23.427911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:10:23.427911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:10:23.428899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2933a-c0a6-4945-abc3-55b29ae4f9e6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.429113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a66d-277a-47e2-b624-a604a08f2d25 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.433522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.434122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.434399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.434677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.435986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.437580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.447662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 769/1557] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:23.453189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.459041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c694c3e-3250-4604-86ea-3d4222d14d3d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.463685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.464268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.464594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.464872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.465589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.465849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.467511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0f0d-de1a-4358-bdaa-1113462328af admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.479840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 770/1558] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.481032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c2a9-95bc-4f3a-86fb-ff8794420459 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.481316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c2a9-95bc-4f3a-86fb-ff8794420459 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.481593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725c2a9-95bc-4f3a-86fb-ff8794420459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.501449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9725c2a9-95bc-4f3a-86fb-ff8794420459 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.502657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9725c2a9-95bc-4f3a-86fb-ff8794420459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.510757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 771/1559] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.511906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a4c4-c8e5-41a8-94bd-889fed50f410 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.512185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a4c4-c8e5-41a8-94bd-889fed50f410 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.512453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a4c4-c8e5-41a8-94bd-889fed50f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.526188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:23.530527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 789/1560] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:23.530527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.530527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.530527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.532599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4f71a4c4-c8e5-41a8-94bd-889fed50f410 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.533878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4f71a4c4-c8e5-41a8-94bd-889fed50f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.542977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 772/1561] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.543705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:23.545379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.545674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.545934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.550447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.551670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.560003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 790/1562] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.561369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.568280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:23.570026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:23.571279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3e087-1bdc-4724-8d61-1542e360972b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.575985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.576700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.576981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.577282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.577514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 773/1563] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:23.578003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.578304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.578412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.579955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.587655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88ff13-3f62-4e21-9c32-d7175dfc9343 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.599170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 791/1564] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.599170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.602494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.602494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.602494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.602494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.602954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.602954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.604331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff509-25c5-460e-893e-522086a53cb6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.606604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 774/1565] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:23.608144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.612063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.612679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.612965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.613239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.613898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.615854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.617896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d09476-0560-4c87-98a8-58a3053e507c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.622545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.623216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.627478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.627478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.627478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.627478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.627478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.639101 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 775/1566] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.650491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.650491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83afa-92ad-4216-a42b-1c2a5c475244 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.655236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.655829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.656144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.656416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.657376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.658985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.668694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 776/1567] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:23.669985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.679229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd6e5-c384-4337-b5ed-d0b15fa17c11 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.683906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.684469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.684748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.685050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.686640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.687090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.688664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.701268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 777/1568] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.702371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.712648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340e38-2b1a-46fa-840a-fc09fa80b450 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.717988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 792/1569] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:23.717988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.723376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.723376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.723376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.723376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.723762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.723762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.723762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.735226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 778/1570] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.736265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.746117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440176b-bbd0-48c7-bd52-821bee172d81 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.785771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057bb5-4648-44b1-864c-849e184bc381 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.790681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.791581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.791717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.791884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.792738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:23.793041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.795335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.806371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.807007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.807296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.807432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 793/1571] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:23.807575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.808302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.808432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.809270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:23.809270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:10:23.809270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:10:23.811202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.820398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708c2c-cbc7-4adc-be11-b81b746c2bf5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.825061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.826273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:23.826273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:23.826521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] PATH_INFO: `/v3/projects/87c14c9f79c64687977a1233d1267e87/users/0255239eb633471da9b946cac26b7f28/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:23.840885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c14c9f79c64687977a1233d1267e87, user_id=0255239eb633471da9b946cac26b7f28, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:23.844990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:23.930365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 779/1572] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:23.931241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.940677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 794/1573] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:23 2022] PUT /identity/v3/projects/87c14c9f79c64687977a1233d1267e87/users/0255239eb633471da9b946cac26b7f28/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:23.941711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:23.994391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8b7a-d082-4a56-b9ca-5c0a9e3e5291 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:23.999120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:23.999763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.000040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.000314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.000983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.002983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.003377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c938394-f810-45c2-9d53-53795e7f57d9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.008126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.008746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.009027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.009305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.010000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.011640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.022121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 795/1574] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:24.022951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.035432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6b17-3d23-4c4a-8f8c-8ed8e8dd9e5d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.040013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.040599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.040882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.041158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.041856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.043788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.119539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 780/1575] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.120563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.125935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:24.147580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 796/1576] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.148724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.163061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:24.188157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614d19-020d-4b49-aa26-d0b10ffed59f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.215477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f0c54-b833-4c77-9f85-93034e647783 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.221581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.222198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.222481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.222820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.223480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.225449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.245670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.246290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.246569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.246964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.247658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.250185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.312697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 797/1577] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.313507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.335256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 781/1578] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.338922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.346601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1704e-d63b-4c22-b317-7c5bd068a137 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.376966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8c9d-72f0-4954-b5dd-942dcbdab8e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.381786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.382401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.382683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.382987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.383676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.385581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154c659-77d7-45fd-933e-5d3fbfa9eff8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.405556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.406170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.406452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.406733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.407409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.409392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.469362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 798/1579] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.470648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.470965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.471244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.489256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:24.490466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:24.495732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 782/1580] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.495732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.503556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d867-3dac-4364-8baa-127f3b5d8ba8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.531083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:24.551930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 799/1581] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:24.558903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.561985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.562752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.563100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.563280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f28ed-972a-42cd-9c19-ea3945afd8f1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.563514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] PATH_INFO: `/v3/projects/e3dc27f60f704d379c05b0f99541b799/users/c71422dd704d4417a1a53c0f65bf98cf/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.568120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.568736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.569016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.569292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.569959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.571967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.580527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dc27f60f704d379c05b0f99541b799, user_id=c71422dd704d4417a1a53c0f65bf98cf, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.581628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:24.581628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:10:24.581628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:10:24.583783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.698601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 800/1582] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.699476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.705813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:24.711761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670ef3-31c8-455c-b63e-cace9de35ea1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.723065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 783/1583] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:24 2022] PUT /identity/v3/projects/e3dc27f60f704d379c05b0f99541b799/users/c71422dd704d4417a1a53c0f65bf98cf/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:24.723065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.769643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.770275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.770554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.770863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.771644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.773876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.776163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3a3a8-bff9-4c9e-b921-5a171a42ed8a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.781295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.782009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.782332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.782602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.783320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.785270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.881391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 801/1584] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.882238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.892383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d617a06-a154-4c87-b62d-fef688cb17d1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.897015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.897602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.897882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.898400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.899125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.900711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.910281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 784/1585] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:24.911233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.915284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 802/1586] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:24.916099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:24.922134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a25e1-9c64-4bfc-9020-6eb4c2109d3a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.926637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14512bd-58e3-4717-ae06-b0392d4f9f9e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:24.931516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.932152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.932800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.932941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:24.933087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.933388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.933862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:24.934133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:24.934448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:24.935007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.935762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:24.937727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:24.946258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 803/1587] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:24.947118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.001730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39942b-bcfa-4187-8ffe-1292b3960104 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.005608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.006224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.006503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.006819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.015858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.017281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b8e3a-424a-4a4d-9db4-b25bb37a56de service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.029409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 785/1588] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:24 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:25.029741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 804/1589] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:25.029834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.029923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.029923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.029923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.039034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a075c-c1c4-4a7e-80e6-2ea5141b7895 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.045361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.045361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.045688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.046046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.046878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.048654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.059725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] MFA Rules not processed for user `c71422dd704d4417a1a53c0f65bf98cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:25.059932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 786/1590] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.061468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.061914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:25.071347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464f1e3-38a9-4382-8a53-dee11c382090 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.076936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.077538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.077923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.078197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.078934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.080632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.090779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 787/1591] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.091599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.101368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973fd6-7052-4595-aa6f-1ff1e3df46ff admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.105902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.106483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.106777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.107761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.108589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.110140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.120440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 788/1592] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.126976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.130011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 805/1593] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:25.130973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.138820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:25.139221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b167-6686-4b53-b3b7-d8913634baf7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.144706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.145360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.145618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9781d2-9a95-49f3-9276-49a9711cc727 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.145738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.145965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.146587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.148538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.154307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.155334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.155827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.156352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.157391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.159118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.161381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 789/1594] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.165330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.170992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 806/1595] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.171962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.176431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c1f9b-5e8a-4456-afdb-1e1ea28ea980 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.181839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.182457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.182567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04c226-5be6-4349-8589-431cc2203ca3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.182760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.183033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.183723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.185924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.188781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.189443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.189730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.190055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.190898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.194611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.196809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 790/1596] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.197468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.207880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ac951-9278-4dae-9036-ef5f65159c1e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.212740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 807/1597] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.212740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.220026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.223443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.223443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.223443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.223443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.223975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4daaa-b3be-498e-90c9-9151cb838d78 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.224077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.227986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.228588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.228861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.229130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.229823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.231838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.234738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 791/1598] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.237461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.242130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 808/1599] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.242934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.250741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49cb4-6e05-41e2-b6b5-b0d68a87fe7c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.253951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a24859-fa1f-43ed-b6ca-a6e788bc3c08 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.256202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.256910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.257258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.257893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.258267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.258825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.259533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.259881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.260222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.260322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] PATH_INFO: `/v3/projects/fe97ce3d979e410ca15529475d4c342e/users/bc8e587cb33a47c7921466f65933401c/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.276926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:25.277863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe97ce3d979e410ca15529475d4c342e, user_id=bc8e587cb33a47c7921466f65933401c, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.286197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.397607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 809/1600] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/fe97ce3d979e410ca15529475d4c342e/users/bc8e587cb33a47c7921466f65933401c/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:25.400863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.407740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 792/1601] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:25 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:25.408873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.468892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506664e7-5da8-42e5-992d-ed99dbcd1f87 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.471719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b683-a33c-47b2-8ffe-ab7c9db10d85 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.473597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.474320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.474601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.474929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] PATH_INFO: `/v3/projects/62ce22d09a6648989c0eb2c79c71f8d9/users/4e10b618c9d349b1835c80cf30f170cd/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.476769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.477594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.477875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.478152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.478871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.480505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.490476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ce22d09a6648989c0eb2c79c71f8d9, user_id=4e10b618c9d349b1835c80cf30f170cd, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.490969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 793/1602] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:25.493389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.495128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.505678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20873a-ce33-4964-9b63-5689c92e9fd2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.510479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.511182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.511465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.511744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] PATH_INFO: `/v3/projects/2209a459f09d4830b7a776d187f07bfc/users/f4b040ee36d744459ad2c8cf2a04d622/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.528168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2209a459f09d4830b7a776d187f07bfc, user_id=f4b040ee36d744459ad2c8cf2a04d622, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.532656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.586478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 810/1603] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/62ce22d09a6648989c0eb2c79c71f8d9/users/4e10b618c9d349b1835c80cf30f170cd/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:25.594655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.624858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 794/1604] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/2209a459f09d4830b7a776d187f07bfc/users/f4b040ee36d744459ad2c8cf2a04d622/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:25.628354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.656270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da6d5-1f6e-416e-8ab4-9efa7f93a4e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.691019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:25.704066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a289d-d5eb-4088-8ab7-5ad8abd0ac20 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.708800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.709478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.709767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.710098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] PATH_INFO: `/v3/projects/da515977c3d046d785b672885e77a4b2/users/596ac3649c7e46bdb494635c416c9f86/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.714861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.715558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.715836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.716107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] PATH_INFO: `/v3/projects/54d9c6954dfa4078b9c7d7ebc4a528e4/users/ad5e482f666f4e2f90f810790bfd67b6/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.725337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da515977c3d046d785b672885e77a4b2, user_id=596ac3649c7e46bdb494635c416c9f86, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.728393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f75873-2f99-465b-8669-389685d17f3d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.731173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d9c6954dfa4078b9c7d7ebc4a528e4, user_id=ad5e482f666f4e2f90f810790bfd67b6, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.735588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.826726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 795/1605] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/da515977c3d046d785b672885e77a4b2/users/596ac3649c7e46bdb494635c416c9f86/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:25.828118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.828405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.828676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.850915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:25.852703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:25.852823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 811/1606] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/54d9c6954dfa4078b9c7d7ebc4a528e4/users/ad5e482f666f4e2f90f810790bfd67b6/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:25.863542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.908213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:25.930118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 796/1607] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:25.931169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:25.940921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31ccd-87ea-4ac0-ba3e-b5c27966c3e4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.947290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.947467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d357b-a00d-4eef-835e-f20588e48177 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:25.947606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.947606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.947606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] PATH_INFO: `/v3/projects/8a0c25ffc61c425ab8fac889126e77d5/users/5aa566a891e64ee6932c460a60a33611/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.952669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:25.953275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:25.953580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:25.953844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:25.954546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.956535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c467c-1a0d-48aa-ad1a-b819136cbcd4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:25.963675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0c25ffc61c425ab8fac889126e77d5, user_id=5aa566a891e64ee6932c460a60a33611, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:25.966605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc06ba7-af5d-4a71-942f-f0107098d454 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.058547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 797/1608] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:25 2022] PUT /identity/v3/projects/8a0c25ffc61c425ab8fac889126e77d5/users/5aa566a891e64ee6932c460a60a33611/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:26.059072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 812/1609] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:25 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:26.061036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b887e5-5941-4e64-a1a6-03b932575fc0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.061382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b887e5-5941-4e64-a1a6-03b932575fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.061721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b887e5-5941-4e64-a1a6-03b932575fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.062281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce2e1-9da4-49d7-ba41-44b3bffa2e0e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.062740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce2e1-9da4-49d7-ba41-44b3bffa2e0e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.063188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce2e1-9da4-49d7-ba41-44b3bffa2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.082783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a2b887e5-5941-4e64-a1a6-03b932575fc0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:26.084088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a2b887e5-5941-4e64-a1a6-03b932575fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.088468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-380ce2e1-9da4-49d7-ba41-44b3bffa2e0e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:26.089712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-380ce2e1-9da4-49d7-ba41-44b3bffa2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.160498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 813/1610] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:26.162046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.162335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.162611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.167937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 798/1611] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:26.167937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.167937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.167937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.190324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:26.191722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.195888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] MFA Rules not processed for user `ad5e482f666f4e2f90f810790bfd67b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:26.197050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.199814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 814/1612] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:26.203532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.252346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:26.261912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39578c-dce7-4d73-b49c-56c9b1dd66ca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.266332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.266974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.267093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 799/1613] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:26.267273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.267525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.267913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.279523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.281248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f346a4-8e7c-40e8-996b-2eecc4e5c8be service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.281588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6b646-0107-447d-b4fb-7bdabe357940 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.287657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.288296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.288574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.288854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.289554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.291619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.292765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 815/1614] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:26.293868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.294151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.295127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.306862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 800/1615] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:26.307798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.309517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.333345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6441c54-1eeb-4f72-87b0-66bf387692a5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.340343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.341019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.341839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.342143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.345428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] MFA Rules not processed for user `5aa566a891e64ee6932c460a60a33611`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:26.348257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:26.352763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.354265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.370906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 801/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:26.372374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.383167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b98f6-f1d4-475e-9162-07831a8df67d service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.389531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.390406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.390959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.391323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.402369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.404525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.434075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 802/1617] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:26.435053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.443037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 816/1618] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:26.444327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.444443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea400-9c3c-4fb0-9486-53d6098139fb service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.453707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.454553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.454960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.456086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.466051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d2a2-4c18-454d-89bf-ee0197c151d8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.472889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.473574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.473913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.474238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.476012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.480395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.486055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.489960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.514743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 803/1619] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:26.517944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.537020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2f33-48ef-4fc3-bdce-8595e36e8b03 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.558126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.558851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.559127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.560050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] PATH_INFO: `/v3/projects/15b9bc5aca5945fdbeff0a056a639c90/users/b644803b1c524976a677b0fcf886d78a/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.563162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:26.580137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b9bc5aca5945fdbeff0a056a639c90, user_id=b644803b1c524976a677b0fcf886d78a, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.588160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.618337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 817/1620] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:26.619343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.704024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872208c-d852-423b-abc9-0b32319d5893 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.715984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 804/1621] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:26 2022] PUT /identity/v3/projects/15b9bc5aca5945fdbeff0a056a639c90/users/b644803b1c524976a677b0fcf886d78a/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:26.717699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.824415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.829145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.829145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.829145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.831378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364a41-6746-4534-b2ee-261a1825d446 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.844317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.845032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.845225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.845505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.846179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.848352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.876069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:26.915292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.916901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.926789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 818/1622] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:26.927698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.948418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c845bc-e726-4a90-892b-ae3c143eecd0 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:26.958953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:26.959704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:26.960082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:26.960454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:26.961259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:26.963063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:26.975417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 819/1623] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:26.980413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.990746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 805/1624] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:26 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:26.994099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:26.995470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faefd02-084f-47d0-983d-272554054c2e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.001790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.002672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.003076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.003486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] PATH_INFO: `/v3/projects/15b9bc5aca5945fdbeff0a056a639c90/users/b644803b1c524976a677b0fcf886d78a/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.005585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b9bc5aca5945fdbeff0a056a639c90, user_id=b644803b1c524976a677b0fcf886d78a, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.008786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062730-6663-4983-975e-1a50b07a112b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.015304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c087a-624b-4a8f-97e5-fdce1cdf2896 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.034527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.035208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.036583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 820/1625] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:26 2022] PUT /identity/v3/projects/15b9bc5aca5945fdbeff0a056a639c90/users/b644803b1c524976a677b0fcf886d78a/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:27.044480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.048762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.048762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.049145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.049145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.049145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.049429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.071058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 806/1626] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:27.075183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:27.096822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ed7e-767e-48c6-ac89-43e1c223cc69 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.130159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] MFA Rules not processed for user `b644803b1c524976a677b0fcf886d78a`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:27.131674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:27.260803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.265244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.265244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.265244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] PATH_INFO: `/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d/users/27175f4771f34bc2b4a18cc1e2b87da4/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.266281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 821/1627] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:27.277802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:27.305298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9aa1b1b8b34a119e1a0f86ea184c2d, user_id=27175f4771f34bc2b4a18cc1e2b87da4, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.308034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.393180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcc23e-103f-49ea-85a5-e78673630896 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.405814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.406465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.406768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.407187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.465256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 807/1628] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:27 2022] PUT /identity/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d/users/27175f4771f34bc2b4a18cc1e2b87da4/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:10:27.469249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:27.510356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:27.538857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.540969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.554236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 822/1629] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:10:27.603436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:27.642250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734966f-6237-4036-b3fb-cef32f6b1b60 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.656667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.660133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.660133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.660133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.660133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.661201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcd873-cc87-4e5a-b921-2a8038039dc9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.687542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:27.695000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 808/1630] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:27.713893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dacdb-36d3-4460-88ea-982b7d33e9b1 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:27.721377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:27.722306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.722992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.723472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] PATH_INFO: `/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d/users/27175f4771f34bc2b4a18cc1e2b87da4/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.735007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9aa1b1b8b34a119e1a0f86ea184c2d, user_id=27175f4771f34bc2b4a18cc1e2b87da4, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:27.737691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:27.761875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 823/1631] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:27 2022] PUT /identity/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d/users/27175f4771f34bc2b4a18cc1e2b87da4/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:10:27.772355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:27.772904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:27.773660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:27.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] MFA Rules not processed for user `27175f4771f34bc2b4a18cc1e2b87da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:27.823869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:27.952861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 809/1632] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:28.297551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:28.376161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3b52e-e205-4ccc-b9b2-35755636b07f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:28.381063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:28.381898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:28.382636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:28.383367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:28.397300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:28.400317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf8d93-6b12-4482-98f6-bf14e3f33dbb service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:28.435618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 824/1633] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:28.845861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:28.856713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f253d-6ec4-4127-ae9f-464b8d8dfb88 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:28.869965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:28.871026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:28.871308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:28.871953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:28.980504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:28.985448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc27d5-1f8d-477d-89f6-8c909fcbdf4f service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:29.022343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 810/1634] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:30.119252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdbbb2-d334-4755-aee1-2698165499f7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:30.124874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdbbb2-d334-4755-aee1-2698165499f7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:30.124874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdbbb2-d334-4755-aee1-2698165499f7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:30.124874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 825/1635] 10.222.0.67 () {54 vars in 962 bytes} [Wed Aug 3 13:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:30.130482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31591bf-316a-41bd-8805-110e72872952 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:30.131527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31591bf-316a-41bd-8805-110e72872952 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:30.131982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31591bf-316a-41bd-8805-110e72872952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:30.201741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d31591bf-316a-41bd-8805-110e72872952 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:30.203029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d31591bf-316a-41bd-8805-110e72872952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:30.254795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:30.298370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 811/1636] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Aug 3 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:30.304433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878c59-4e17-4e8e-9290-dec227567f50 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:30.304721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878c59-4e17-4e8e-9290-dec227567f50 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:30.305000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878c59-4e17-4e8e-9290-dec227567f50 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:30.306657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 826/1637] 10.222.0.67 () {54 vars in 912 bytes} [Wed Aug 3 13:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:30.313136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:30.313636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:30.314055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:30.345041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:30.346657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:30.359629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 812/1638] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:30.373817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26878c59-4e17-4e8e-9290-dec227567f50 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:30.386691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26878c59-4e17-4e8e-9290-dec227567f50 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:30.389744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:30.390361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:30.390639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:30.390956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:30.407511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:30.410203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b10f-dd16-4cca-8fa1-70f15cbf94c4 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:30.435767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 827/1639] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:32.532436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:32.555564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf87ec2-1673-4351-ad55-a28351312a4d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:32.564022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:32.565506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:32.565993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:32.566520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:32.753006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:32.756462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f115491-e530-460b-92b1-b79c92df8d70 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:32.786033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 813/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:32.997939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e4c-6bbf-4ff3-81dc-b9e0fd21b4e6 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:33.002945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e4c-6bbf-4ff3-81dc-b9e0fd21b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:33.002945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097e4c-6bbf-4ff3-81dc-b9e0fd21b4e6 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:33.002945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 828/1641] 10.222.0.67 () {54 vars in 962 bytes} [Wed Aug 3 13:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:33.006925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7816-1dee-4d54-83fc-0f4c816c378f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:33.007210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7816-1dee-4d54-83fc-0f4c816c378f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:33.007483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d7816-1dee-4d54-83fc-0f4c816c378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:33.029636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-421d7816-1dee-4d54-83fc-0f4c816c378f None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:33.031780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-421d7816-1dee-4d54-83fc-0f4c816c378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:33.042800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 814/1642] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Aug 3 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:33.048069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06ef4-f9de-4a75-a93a-3721ca64f6b7 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:33.048354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06ef4-f9de-4a75-a93a-3721ca64f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:33.048645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06ef4-f9de-4a75-a93a-3721ca64f6b7 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:33.049984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 829/1643] 10.222.0.67 () {54 vars in 912 bytes} [Wed Aug 3 13:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:33.057412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfca85-e2c0-4e1f-b954-8fca73dfb298 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:33.058001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfca85-e2c0-4e1f-b954-8fca73dfb298 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:33.058107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfca85-e2c0-4e1f-b954-8fca73dfb298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:33.080496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-51bfca85-e2c0-4e1f-b954-8fca73dfb298 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:33.081940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-51bfca85-e2c0-4e1f-b954-8fca73dfb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:33.111889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 815/1644] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:33.121998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06ef4-f9de-4a75-a93a-3721ca64f6b7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:33.154928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06ef4-f9de-4a75-a93a-3721ca64f6b7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:33.179413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:33.180227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:33.181124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:33.181669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:33.218215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:33.220323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:33.243736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 830/1645] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:38.979992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51c24-a3fa-4bb5-bf4c-55b4a0a46973 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:38.980482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51c24-a3fa-4bb5-bf4c-55b4a0a46973 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:38.980578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51c24-a3fa-4bb5-bf4c-55b4a0a46973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:39.055736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b4a51c24-a3fa-4bb5-bf4c-55b4a0a46973 None None] MFA Rules not processed for user `596ac3649c7e46bdb494635c416c9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:39.057338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b4a51c24-a3fa-4bb5-bf4c-55b4a0a46973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:39.179852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 816/1646] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:39.194046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:39.211980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c017c7-a555-474f-8f7c-c4fc3c7f8dc2 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:39.213447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:39.213742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:39.214024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:39.227425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:39.228493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:39.232681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:39.232681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:39.249084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:39.250936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2305-7f26-440b-b60d-a762003e2608 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:39.273688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] MFA Rules not processed for user `0255239eb633471da9b946cac26b7f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:39.276542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 831/1647] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:39.277127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:39.384633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:39.488985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 817/1648] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:39.503063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7c759-deb6-4b6e-aed1-71e2374f481b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:39.503448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7c759-deb6-4b6e-aed1-71e2374f481b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:39.503735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7c759-deb6-4b6e-aed1-71e2374f481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:39.537517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ed7c759-deb6-4b6e-aed1-71e2374f481b None None] MFA Rules not processed for user `0255239eb633471da9b946cac26b7f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:39.539096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ed7c759-deb6-4b6e-aed1-71e2374f481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:39.563025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 832/1649] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:39.570909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:39.585310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43d405-e7b9-439b-abbc-e371a3c7a212 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:39.591991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:39.592353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:39.592724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:39.593006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:39.602622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:39.605566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0d00-2c03-4447-8fb9-befaff377a2f service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:39.619310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 818/1650] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:40.754241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be8f08-fc28-4844-8223-46e03ea823cc None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:40.755120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be8f08-fc28-4844-8223-46e03ea823cc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:40.755120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be8f08-fc28-4844-8223-46e03ea823cc None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:40.756477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 833/1651] 10.222.0.67 () {54 vars in 912 bytes} [Wed Aug 3 13:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:40.773608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:40.773608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:40.773608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:40.881791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:40.883348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:41.167300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 819/1652] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:41.204160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be8f08-fc28-4844-8223-46e03ea823cc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:41.240221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be8f08-fc28-4844-8223-46e03ea823cc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:41.258787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:41.262395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:41.264028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:41.265399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:41.313907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:41.317940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaec383-f7b2-4b51-b8c1-fd438f8b993d service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:41.353569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 834/1653] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:42.224490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:42.372065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106794-6bd4-4e67-bbba-a8b135931621 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:42.389423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:42.390246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:42.390596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:42.390983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] PATH_INFO: `/v3/users/5aa566a891e64ee6932c460a60a33611` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:42.393261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa566a891e64ee6932c460a60a33611)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:42.394981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:42.394981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: warnings.warn(msg) Aug 03 13:10:42.394981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: Aug 03 13:10:42.396506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:42.737326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa566a891e64ee6932c460a60a33611'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:42.742893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa566a891e64ee6932c460a60a33611'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:42.787094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa566a891e64ee6932c460a60a33611'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:42.798901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:42.820484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa566a891e64ee6932c460a60a33611'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:42.856160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cbcd-1de1-4f53-bb63-4250da9b0458 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:42.857158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cbcd-1de1-4f53-bb63-4250da9b0458 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:42.857817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558cbcd-1de1-4f53-bb63-4250da9b0458 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:42.860503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 835/1654] 10.222.0.67 () {54 vars in 961 bytes} [Wed Aug 3 13:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:10:42.865922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf2d-4465-4440-9902-4ebdb6ce0a6b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:42.866502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf2d-4465-4440-9902-4ebdb6ce0a6b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:42.867071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9bf2d-4465-4440-9902-4ebdb6ce0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:42.922815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2ef9bf2d-4465-4440-9902-4ebdb6ce0a6b None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:42.923015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9479497c-272a-4b40-9c9c-75afffa4c198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa566a891e64ee6932c460a60a33611'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:42.925490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2ef9bf2d-4465-4440-9902-4ebdb6ce0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:42.937812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 820/1655] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:10:42 2022] DELETE /identity/v3/users/5aa566a891e64ee6932c460a60a33611 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:42.959081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:42.965430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:42.965430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.043058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:43.043058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.106926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 836/1656] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Aug 3 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:43.110431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad2a9-21ae-47a7-a5a0-721b862387dd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:43.116152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad2a9-21ae-47a7-a5a0-721b862387dd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:43.123380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ad2a9-21ae-47a7-a5a0-721b862387dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.132339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:43.190053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 821/1657] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:43.191760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:43.203189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-162ad2a9-21ae-47a7-a5a0-721b862387dd None None] MFA Rules not processed for user `4e10b618c9d349b1835c80cf30f170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:43.204479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-162ad2a9-21ae-47a7-a5a0-721b862387dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.367695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80fc8f-cecd-44b2-8e8e-5d41e70db74b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:43.375272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:43.376809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:43.377257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:43.377540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.381890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.403263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:43.405718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:43.425258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 822/1658] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:43.428001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:43.432583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.483521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 837/1659] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:43.495306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:43.495611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:43.495893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.539460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] MFA Rules not processed for user `4e10b618c9d349b1835c80cf30f170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:43.541144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.556799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869b9e-1dcd-4db4-bde8-8f3a7a7e4627 service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:43.561313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 838/1660] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:43.566113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:43.574123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:43.574387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:43.574473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.575262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:43.577888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:43.593850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:43.595365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51adec-fc7d-4d40-8f73-6972a3424e50 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:43.627203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 823/1661] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:43.727656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0411e1-47ba-4c20-ae36-4f68030b078b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:43.736184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:43.737932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:43.738039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:43.738324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:43.750333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:43.752202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:43.777575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 839/1662] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:44.899515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:44.900107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:44.900238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:44.956279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:44.977007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] MFA Rules not processed for user `bc8e587cb33a47c7921466f65933401c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:44.988666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:45.124458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:45.126309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:45.146292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 824/1663] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:45.148935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fa23e-51a4-4b48-8ea3-a89af67f4ae4 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:45.165047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:45.165957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:45.166452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:45.167262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] PATH_INFO: `/v3/projects/8a0c25ffc61c425ab8fac889126e77d5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:45.168746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:45.171394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0c25ffc61c425ab8fac889126e77d5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:45.172560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:45.174805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: WARNING py.warnings [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 13:10:45.174805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: warnings.warn(msg) Aug 03 13:10:45.174805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: Aug 03 13:10:45.177247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:45.223802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd78cab-cd7a-4a94-ba56-a950e75303fb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:45.258679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:45.259281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:45.259567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:45.259843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:45.293350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:45.299310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09bb10-f21b-49e9-af75-1c07675cc9c5 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:45.322118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 825/1664] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:45.434627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0c25ffc61c425ab8fac889126e77d5', 'request_id': 'req-1424cdfc-c6ee-47d9-995c-794dded309bd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:45.444517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0c25ffc61c425ab8fac889126e77d5', 'request_id': 'req-1424cdfc-c6ee-47d9-995c-794dded309bd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:45.552864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0c25ffc61c425ab8fac889126e77d5', 'request_id': 'req-1424cdfc-c6ee-47d9-995c-794dded309bd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:45.568830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:45.630508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] The token cache is being invalidate because project 8a0c25ffc61c425ab8fac889126e77d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:10:45.632355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:45.634861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1424cdfc-c6ee-47d9-995c-794dded309bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:45.644523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 840/1665] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:10:45 2022] DELETE /identity/v3/projects/8a0c25ffc61c425ab8fac889126e77d5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:10:45.649901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:45.650408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:45.650861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:45.689642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:45.691180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:45.863835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 826/1666] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:45.865304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:45.866036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:45.866488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:45.908170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:45.911110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:45.930761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 841/1667] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:45.935484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:45.943953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e84f57-eeaf-48a0-a1fe-95281b213d7a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:45.950340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:45.951570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:45.952201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:45.952619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:45.953525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:45.954225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:45.956523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:45.980245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 827/1668] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:10:45.984341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:45.995869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce206e7-5c30-45eb-97f4-5865c03a953e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:46.016484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:46.018846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.020433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.020433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.021379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:46.037204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d6104-9bc3-4a76-b908-0a8b5e9ea13f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:46.226969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:46.236247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 842/1669] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:45 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:46.241530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021f7e0-43fa-42a0-a8be-74bfab5a2d31 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:46.339563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.339845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.340286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.372231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] MFA Rules not processed for user `4e10b618c9d349b1835c80cf30f170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:46.374964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:46.399032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:46.399847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.400303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.400734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.401580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:46.404529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:46.480940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 843/1670] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:46.539497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 828/1671] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:46 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:46.543895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:46.575072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e2eb2-90ee-400f-8430-7d2825fdea62 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:46.595044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:46.596675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.597120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.599189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.602426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:46.606331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:46.627399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 844/1672] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:46.631360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:46.651320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636d709-0f61-416d-8edd-ec9265878d1e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:46.663013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:46.664026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.664399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.664729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.665731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:46.675891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4d187-3e2a-4892-bffc-cf4910de4775 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:46.692497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 829/1673] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:46.696257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:46.710155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00e0af-538d-457e-bae3-b8a32cbb8c35 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:46.731058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:46.739813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.739813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.739813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] PATH_INFO: `/v3/projects/77402428cde94b8d8cb12c273e1d2848/users/bc1cc118996941b5a498bbf291cd8dca/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.749578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.750023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.750310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:46.798658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77402428cde94b8d8cb12c273e1d2848, user_id=bc1cc118996941b5a498bbf291cd8dca, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:46.801595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb0dda-a241-4778-9283-0fe791f2004e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:46.823913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] MFA Rules not processed for user `f4b040ee36d744459ad2c8cf2a04d622`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:46.825156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:46.913520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 845/1674] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:46 2022] PUT /identity/v3/projects/77402428cde94b8d8cb12c273e1d2848/users/bc1cc118996941b5a498bbf291cd8dca/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:46.925413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:46.925948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:46.926374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:47.008864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] MFA Rules not processed for user `bc1cc118996941b5a498bbf291cd8dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:47.014546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:47.027777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 830/1675] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:47.265169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:47.267453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 846/1676] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:10:47.285568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d4fbf-7943-4476-8315-7a6ec8195c43 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:47.363614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:47.369501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:47.369501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:47.369501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:47.369501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:47.369501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:47.428459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:47.431131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:47.551374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 831/1677] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:47 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:47.555666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:47.658595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29240-225f-4eb0-9fe7-6ed034e2e4b1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:47.945875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073f9e-ed02-49a3-bccf-921c86549364 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:47.946839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:47.951340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:47.952639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:47.953098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:47.972105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:47.973024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:47.974015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:47.976655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:47.977586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:47.988801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.021996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:48.132021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 832/1678] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:47 2022] POST /identity/v3/users => generated 299 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:48.135220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:48.172606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1bc61-c68a-479a-849c-75e681e324d0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:48.178624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:48.180840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.186406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:48.187096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:48.187374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:48.187646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:48.188372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:48.190038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.210219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 847/1679] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:48.217957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 833/1680] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:10:48.232114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:48.264994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c767c2-cd0b-49d1-8175-b81f73bdcaf1 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:48.278418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:48.280945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:48.282851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:48.283145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] PATH_INFO: `/v3/projects/feea52651b914eb1b4e6918dcd17b936/users/d8fe2ce89c87435598c4d75655f36a8c/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:48.382108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feea52651b914eb1b4e6918dcd17b936, user_id=d8fe2ce89c87435598c4d75655f36a8c, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:48.391552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.539710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 848/1681] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:48 2022] PUT /identity/v3/projects/feea52651b914eb1b4e6918dcd17b936/users/d8fe2ce89c87435598c4d75655f36a8c/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:48.546084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:48.566824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e247130-82e2-41b7-88ea-5914867a1bbc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:48.707846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:48.708829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:48.709302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:48.709920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:48.711036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:48.715165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:48.715303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345183ca-a498-4d89-aea5-ca9752ecdbee admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.733767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 834/1682] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:48.738035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:48.754076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6a602-7fff-4510-a3ef-61d5a7cdd135 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:48.763901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:48.764926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:48.765536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:48.766162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] PATH_INFO: `/v3/projects/feea52651b914eb1b4e6918dcd17b936/users/d8fe2ce89c87435598c4d75655f36a8c/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:48.770293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feea52651b914eb1b4e6918dcd17b936, user_id=d8fe2ce89c87435598c4d75655f36a8c, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:48.777652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1fdd6-a7e9-4b32-bfde-aca08fc2e690 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:48.795455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 849/1683] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:48 2022] PUT /identity/v3/projects/feea52651b914eb1b4e6918dcd17b936/users/d8fe2ce89c87435598c4d75655f36a8c/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:10:48.808097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:48.809206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:48.810242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:48.955154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] MFA Rules not processed for user `d8fe2ce89c87435598c4d75655f36a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:48.965135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:49.292822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 835/1684] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:49.362627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03979-5b08-4c8f-9840-7570fa55c667 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:49.363145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03979-5b08-4c8f-9840-7570fa55c667 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:49.363316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03979-5b08-4c8f-9840-7570fa55c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:49.418636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:49.421687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:49.472037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f8b03979-5b08-4c8f-9840-7570fa55c667 None None] MFA Rules not processed for user `596ac3649c7e46bdb494635c416c9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:49.476594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f8b03979-5b08-4c8f-9840-7570fa55c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:49.610498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb54996-b78d-487a-8534-f502145c9d6a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:49.615506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:49.616395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:49.616867 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:49.617332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:49.645647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:49.652982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:49.704399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 836/1685] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:10:49.739610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 850/1686] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:49.779883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:49.941784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128eb1a-8d73-4bf5-81d8-4b6239f8a7c1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:49.947937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:49.948841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:49.949465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:49.954431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] PATH_INFO: `/v3/users/bc1cc118996941b5a498bbf291cd8dca` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:49.965206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1cc118996941b5a498bbf291cd8dca)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:49.968560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:50.037186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:50.299426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4243ab-141a-4557-b207-041181fcfcb0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:50.300804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4243ab-141a-4557-b207-041181fcfcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:50.300804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4243ab-141a-4557-b207-041181fcfcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:50.321281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1cc118996941b5a498bbf291cd8dca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:50.323310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1cc118996941b5a498bbf291cd8dca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:50.344456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1cc118996941b5a498bbf291cd8dca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:50.412935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1cc118996941b5a498bbf291cd8dca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:50.428457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5f4243ab-141a-4557-b207-041181fcfcb0 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:50.436214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5f4243ab-141a-4557-b207-041181fcfcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:50.517783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a79230d-365b-4615-a712-5d99c0b5262f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1cc118996941b5a498bbf291cd8dca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:50.538080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 837/1687] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:10:49 2022] DELETE /identity/v3/users/bc1cc118996941b5a498bbf291cd8dca => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:50.542226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd4a7-c2ef-4d63-8acc-442c77dde387 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:50.542676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd4a7-c2ef-4d63-8acc-442c77dde387 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:50.549281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd4a7-c2ef-4d63-8acc-442c77dde387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:50.613455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-966bd4a7-c2ef-4d63-8acc-442c77dde387 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:50.617992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-966bd4a7-c2ef-4d63-8acc-442c77dde387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:50.686535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 851/1688] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:50.804247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:50.814819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 838/1689] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:50.831220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:50.831220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:50.831220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:50.846021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 852/1690] 10.222.0.67 () {54 vars in 912 bytes} [Wed Aug 3 13:10:50 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:10:50.864091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:50.864686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:50.865158 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:50.887030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:50.889027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:50.996981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:50.999194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:51.148924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a779-54b0-482b-96a0-420c62fae81e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:51.157166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:51.158071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:51.158524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:51.158981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:51.182985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 839/1691] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:10:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:51.191075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:51.194503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:51.208398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 853/1692] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:51.272906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:51.275194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:51.283208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:51.284219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:51.308550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3416-848a-49f3-97a4-b77a42495ac9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:51.320326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:51.321950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:51.324126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:51.327091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:51.349551 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:51.354976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:51.383475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 840/1693] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:51.479796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56652b50-b2a6-4899-bda0-27df90d1f2de service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:51.489181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:51.490146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:51.490616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:51.491099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:51.688051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:51.689844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697f95c-284f-48ec-a820-d7786873f81e service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:51.708919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 854/1694] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:10:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:10:52.226196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:52.985667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:52.988271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:53.037227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8e152-c97f-436b-8c97-b1a5788b7c1c service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:53.043744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:53.045772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:53.046271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:53.046899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] PATH_INFO: `/v3/projects/77402428cde94b8d8cb12c273e1d2848` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:53.048667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77402428cde94b8d8cb12c273e1d2848)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:53.051492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:53.351694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:53.431404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77402428cde94b8d8cb12c273e1d2848', 'request_id': 'req-73b89c39-be89-454e-88f5-643df61caf29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:53.453302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77402428cde94b8d8cb12c273e1d2848', 'request_id': 'req-73b89c39-be89-454e-88f5-643df61caf29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:53.488949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77402428cde94b8d8cb12c273e1d2848', 'request_id': 'req-73b89c39-be89-454e-88f5-643df61caf29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:53.539425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:53.539698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:53.539981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:53.582895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] MFA Rules not processed for user `bc8e587cb33a47c7921466f65933401c`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:53.584632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:53.706695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 855/1695] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:53.754757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] The token cache is being invalidate because project 77402428cde94b8d8cb12c273e1d2848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:10:53.758189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:53.763659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:53.772412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 841/1696] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:10:52 2022] DELETE /identity/v3/projects/77402428cde94b8d8cb12c273e1d2848 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:53.776620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:53.807348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:53.809129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:53.836706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:54.006202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd7ad-51db-4c81-95bc-744515a0d36f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:54.038004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:54.038937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:54.040543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:54.040839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] PATH_INFO: `/v3/users/d8fe2ce89c87435598c4d75655f36a8c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:54.044857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fe2ce89c87435598c4d75655f36a8c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:54.049799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:54.075151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b89c39-be89-454e-88f5-643df61caf29 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:54.124562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:54.130578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:54.130578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:54.133494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] PATH_INFO: `/v3/users/c71422dd704d4417a1a53c0f65bf98cf` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:54.136241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71422dd704d4417a1a53c0f65bf98cf)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:54.140902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:54.451622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fe2ce89c87435598c4d75655f36a8c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.451622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fe2ce89c87435598c4d75655f36a8c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.461196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fe2ce89c87435598c4d75655f36a8c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.512273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fe2ce89c87435598c4d75655f36a8c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.582408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:54.597242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71422dd704d4417a1a53c0f65bf98cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.599358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71422dd704d4417a1a53c0f65bf98cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.613682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71422dd704d4417a1a53c0f65bf98cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.659281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5a9d5c7a-e444-450a-8980-80f95bc1f7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fe2ce89c87435598c4d75655f36a8c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.680380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71422dd704d4417a1a53c0f65bf98cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.699521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 856/1697] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:10:53 2022] DELETE /identity/v3/users/d8fe2ce89c87435598c4d75655f36a8c => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:54.702335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:54.703209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:54.703645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:54.795356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:54.800809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1e314ab7-bf7d-4c4f-8db1-4536a0942152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71422dd704d4417a1a53c0f65bf98cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:54.802208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:54.813539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 842/1698] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:10:53 2022] DELETE /identity/v3/users/c71422dd704d4417a1a53c0f65bf98cf => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:54.815350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:54.815702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:54.815989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:54.923393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:54.935609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:54.991717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 857/1699] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Aug 3 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:55.113850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:55.116013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:55.127571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 843/1700] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:55.143118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695068-9b59-4b93-9ff3-fecf8a6bedcf None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:55.156326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:55.159248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:55.159506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:55.159752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:55.174745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:55.191846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:55.193318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:55.195695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270419d9-16d2-43fa-b234-4ec68125a178 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:55.213768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:55.215068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:55.217040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:55.221464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:55.229837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 858/1701] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:10:55.273346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:55.273346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:55.273346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 844/1702] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:10:56.968399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:56.970191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:56.999498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e015c-6918-4c13-89f5-5a816206ef0a service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:57.012691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:57.013998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:57.014281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:57.014609 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] PATH_INFO: `/v3/projects/feea52651b914eb1b4e6918dcd17b936` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:57.017777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=feea52651b914eb1b4e6918dcd17b936)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:57.022917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:57.104134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:57.106509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:57.134338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6e29e-7626-4c81-ab21-0f638c0d320d service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:57.151000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:57.166936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:57.166936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:57.167818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] PATH_INFO: `/v3/projects/e3dc27f60f704d379c05b0f99541b799` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:57.173805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dc27f60f704d379c05b0f99541b799)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:57.175976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:57.221593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feea52651b914eb1b4e6918dcd17b936', 'request_id': 'req-155d6403-04fe-42be-bcc0-304d84fb70ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.246484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feea52651b914eb1b4e6918dcd17b936', 'request_id': 'req-155d6403-04fe-42be-bcc0-304d84fb70ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.546462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feea52651b914eb1b4e6918dcd17b936', 'request_id': 'req-155d6403-04fe-42be-bcc0-304d84fb70ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.570383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] The token cache is being invalidate because project feea52651b914eb1b4e6918dcd17b936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:10:57.570681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.573172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-155d6403-04fe-42be-bcc0-304d84fb70ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.576519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 859/1703] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:10:56 2022] DELETE /identity/v3/projects/feea52651b914eb1b4e6918dcd17b936 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:57.584108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30683fa-da96-4ea3-9d02-c3eb030f43d2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:57.589695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30683fa-da96-4ea3-9d02-c3eb030f43d2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:57.590722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30683fa-da96-4ea3-9d02-c3eb030f43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:57.686841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dc27f60f704d379c05b0f99541b799', 'request_id': 'req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.716790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dc27f60f704d379c05b0f99541b799', 'request_id': 'req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.730745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c30683fa-da96-4ea3-9d02-c3eb030f43d2 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:57.737642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:57.737976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c30683fa-da96-4ea3-9d02-c3eb030f43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:57.752362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:10:57.769411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dc27f60f704d379c05b0f99541b799', 'request_id': 'req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.869281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] The token cache is being invalidate because project e3dc27f60f704d379c05b0f99541b799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:10:57.869634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.870527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:57.884227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 845/1704] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:10:57 2022] DELETE /identity/v3/projects/e3dc27f60f704d379c05b0f99541b799 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:10:57.885590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:57.895285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:57.961580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 860/1705] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:57.971161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:57.971817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:57.971817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:58.034862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:58.039515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:58.065289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 861/1706] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:58.069998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ebf-bc96-46e5-82f3-acd0b0de2a55 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:58.076091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:58.076740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:58.077067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:58.077472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:58.077861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] PATH_INFO: `/v3/users/b644803b1c524976a677b0fcf886d78a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:58.079264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b644803b1c524976a677b0fcf886d78a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:58.081573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:58.096355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da78e-9dd5-4b04-beec-fc61973b6e66 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:58.113003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:58.113977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:58.114555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:58.115007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:58.115859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:10:58.116317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:58.120807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:58.149457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 862/1707] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:10:58.153499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:58.174260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4d036-4cba-40b7-8888-65a8af279896 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:58.193290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:58.194046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:58.194199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:58.194476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:58.195253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:58.197430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:58.430481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 863/1708] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:58.432019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:58.555279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b644803b1c524976a677b0fcf886d78a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:58.557289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b644803b1c524976a677b0fcf886d78a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:58.602223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b644803b1c524976a677b0fcf886d78a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:58.631726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b644803b1c524976a677b0fcf886d78a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:58.695144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9eee-88c4-446a-906a-e314a4a2b0ec admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:58.705761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:58.707860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:58.708266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:58.708448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:58.714126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:58.721066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f581161-f30f-450c-b477-d8f0d9717d04 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:58.761463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b644803b1c524976a677b0fcf886d78a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:10:58.765932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 846/1709] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:10:57 2022] DELETE /identity/v3/users/b644803b1c524976a677b0fcf886d78a => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:58.949564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 864/1710] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:10:58 2022] POST /identity/v3/users => generated 293 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:10:58.963869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:58.965587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:58.990548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:58.992067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:58.992472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.053482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] MFA Rules not processed for user `f4b040ee36d744459ad2c8cf2a04d622`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:59.062301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:59.175775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be2f53-7eff-40c0-b047-76ad5561f254 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:59.183582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:59.185840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:59.186221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:59.187356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.188267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:59.190801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:59.239430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 847/1711] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:59.240391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:59.286771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f6849-6632-4c9c-af2c-79a84685be3a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:59.295945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 865/1712] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:59.299390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:59.300741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:59.300952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:59.301390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.302098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:59.310368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14f8a0-7147-4603-b221-3d46311b24b3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:59.349674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 848/1713] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:10:59.350939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:59.369648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16986d-f849-4188-82cb-f7c7b32b2ad3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:59.383272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:59.384049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:59.384415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:59.384615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] PATH_INFO: `/v3/projects/53514ef4208848abb64b46edabb7ed6a/users/6e84d46aba7b43448fa016ccec4ea8c9/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.442635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53514ef4208848abb64b46edabb7ed6a, user_id=6e84d46aba7b43448fa016ccec4ea8c9, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:59.445363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:10:59.539251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 866/1714] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:10:59 2022] PUT /identity/v3/projects/53514ef4208848abb64b46edabb7ed6a/users/6e84d46aba7b43448fa016ccec4ea8c9/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:10:59.551346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:59.552693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:59.552693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.621491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] MFA Rules not processed for user `6e84d46aba7b43448fa016ccec4ea8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:10:59.633094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:10:59.772752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 849/1715] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:10:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:10:59.774351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:10:59.912973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14b3b-5ca0-44b3-9a0e-c1b9c5da6901 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:10:59.927553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:10:59.928559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:10:59.929005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:10:59.929439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:10:59.930483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:10:59.933333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:00.041267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 867/1716] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:00.047830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:00.082419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287a7e-92cd-447c-a52e-fe4889c575b8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:00.219106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:00.220964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:00.221876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:00.223353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:00.226696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:00.228747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:00.590606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 850/1717] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:00 2022] POST /identity/v3/users => generated 299 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:00.596567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:00.618165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8028f0-de3e-4188-9462-51d71edeeb98 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:00.649005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:00.652723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:00.656221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:00.656749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:00.660519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:00.671484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:00.701314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 868/1718] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:00.705190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:00.724139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94fae3-61f4-46e3-b97d-e75b8704d1bf admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:00.749898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:00.749898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:00.749898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:00.749898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] PATH_INFO: `/v3/projects/0bbdf634edb74cf18dec7d166feec40c/users/76f05c624474497ca3dd1722b7c64c0d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:00.775462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbdf634edb74cf18dec7d166feec40c, user_id=76f05c624474497ca3dd1722b7c64c0d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:00.778997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:01.128267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 851/1719] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:00 2022] PUT /identity/v3/projects/0bbdf634edb74cf18dec7d166feec40c/users/76f05c624474497ca3dd1722b7c64c0d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:01.133644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:01.180612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed623f8-a4fc-457c-8f97-239e8db328e5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:01.272396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:01.343779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:01.344973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:01.345485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:01.345913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:01.359641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:01.368509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b59378-edb9-4e95-83f0-4c3a938a7f08 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:01.384421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 869/1720] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:01.388796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:01.402966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90896e-4777-49f4-b434-27bd14018c0a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:01.431415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:01.432125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:01.435137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:01.435691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] PATH_INFO: `/v3/projects/0bbdf634edb74cf18dec7d166feec40c/users/76f05c624474497ca3dd1722b7c64c0d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:01.442430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbdf634edb74cf18dec7d166feec40c, user_id=76f05c624474497ca3dd1722b7c64c0d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:01.446537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20601-b530-4355-8679-2a42f8ea226c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:01.515997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 852/1721] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:01 2022] PUT /identity/v3/projects/0bbdf634edb74cf18dec7d166feec40c/users/76f05c624474497ca3dd1722b7c64c0d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:01.541863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:01.542273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:01.542795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:01.552332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:01.588176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] MFA Rules not processed for user `76f05c624474497ca3dd1722b7c64c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:01.590223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:01.770373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca53-4d79-485b-a735-dcb7d05e667a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:01.770951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca53-4d79-485b-a735-dcb7d05e667a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:01.770951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bca53-4d79-485b-a735-dcb7d05e667a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:01.772828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 853/1722] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:11:01.801276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:01.801831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:01.806035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:01.838979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 870/1723] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:01.851774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:01.853437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:01.858144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:01.859699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:02.109037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d064a-4aa7-4c3b-9de6-cf0338c3104f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:02.109037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:02.109037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:02.109037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:02.110655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:02.110655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:02.110655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:02.115182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 854/1724] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:11:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:02.115479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 871/1725] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:02.116253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:02.116253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:02.222571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:02.328000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eb806-518e-4d54-8d55-70ec41e8a520 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:02.358945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:02.359849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:02.360880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:02.361309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] PATH_INFO: `/v3/projects/15b9bc5aca5945fdbeff0a056a639c90` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:02.363443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b9bc5aca5945fdbeff0a056a639c90)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:02.367720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:02.438883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917eec-1d1f-4798-81cd-7d35cf5b6713 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:02.452707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:02.455547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:02.455907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:02.456262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] PATH_INFO: `/v3/users/6e84d46aba7b43448fa016ccec4ea8c9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:02.460561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e84d46aba7b43448fa016ccec4ea8c9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:02.464294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:02.601608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b9bc5aca5945fdbeff0a056a639c90', 'request_id': 'req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.616857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b9bc5aca5945fdbeff0a056a639c90', 'request_id': 'req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.642228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b9bc5aca5945fdbeff0a056a639c90', 'request_id': 'req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.736348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] The token cache is being invalidate because project 15b9bc5aca5945fdbeff0a056a639c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:02.736348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.736348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.739584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 855/1726] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:02 2022] DELETE /identity/v3/projects/15b9bc5aca5945fdbeff0a056a639c90 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:02.745120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:02.749281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:02.762895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e84d46aba7b43448fa016ccec4ea8c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.765574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e84d46aba7b43448fa016ccec4ea8c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.766527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e84d46aba7b43448fa016ccec4ea8c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.833526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e84d46aba7b43448fa016ccec4ea8c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:02.972024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f2f5-23c5-4f6a-bbe3-52ca6ad0d462 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:02.990638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:02.991369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:02.991657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:02.991936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:02.998197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:03.040922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:03.045904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f3611-bf04-4e2a-93bd-bdb54bbbb5cc service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:03.090844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 856/1727] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:03.095780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-017f6a1a-2672-4b4f-aa90-169c320a40cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e84d46aba7b43448fa016ccec4ea8c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:03.104315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.107602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.108088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.129450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 872/1728] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:02 2022] DELETE /identity/v3/users/6e84d46aba7b43448fa016ccec4ea8c9 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:03.142238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e334a-351e-43b9-972a-7edeabd31818 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.145894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e334a-351e-43b9-972a-7edeabd31818 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.146248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e334a-351e-43b9-972a-7edeabd31818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.187815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fe1e334a-351e-43b9-972a-7edeabd31818 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:03.190873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe1e334a-351e-43b9-972a-7edeabd31818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:03.232491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:03.233948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:03.321679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 873/1729] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:03.404307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 857/1730] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:03.409715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.410228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.410651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.459353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:03.471496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:03.494040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:03.496021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:03.521876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 874/1731] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:03.523492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:03.550058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb834d6f-9d78-45dc-a218-6dba45c6d6c2 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:03.567856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:03.569010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.569010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.569478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.570486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:03.570974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:03.572943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:03.602459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 875/1732] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:03.607860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:03.633333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88deb11-8855-405c-95d8-30a6143277e4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:03.652859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:03.659114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.664215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.664215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.664215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:03.664595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd40274-8998-40f9-8a26-e784f5ceac5a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:03.668461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:03.669937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.670222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.670495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.670610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:03.689352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:03.692901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:03.719023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 858/1733] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:03.813215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 876/1734] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:03 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:03.817574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:03.839086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a0e14-0470-41d5-8edb-40b196cb6472 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:03.935216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:03.971576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:03.972669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:03.973259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:03.973259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:03.974742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:03.977411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:04.390632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 859/1735] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:03 2022] POST /identity/v3/users => generated 284 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:04.395000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:04.407500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ef2a-1b6d-4991-82e0-53cd20c7d606 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:04.412760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:04.416148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:04.416148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:04.416148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:04.416148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:04.416595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:04.428695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 877/1736] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:04.433005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:04.445262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59e3b-e24e-4cb7-9226-bb58586bd1ec admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:04.451957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:04.452658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:04.452950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:04.453207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:04.453925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:04.455787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f6ef7-358a-4078-af5f-f9e2cfdafb1b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:04.497978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 860/1737] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:04.498414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:04.511984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df60e-892d-483c-9095-c0cb9cfe32e1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:04.524976 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:04.528856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:04.528856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:04.528856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] PATH_INFO: `/v3/projects/2a91cc246a34454ab6b91a192a4fac75/users/5c5db3b63f3541939afb8f37c72748ea/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:04.610165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a91cc246a34454ab6b91a192a4fac75, user_id=5c5db3b63f3541939afb8f37c72748ea, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:04.615017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:04.782401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 878/1738] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:04 2022] PUT /identity/v3/projects/2a91cc246a34454ab6b91a192a4fac75/users/5c5db3b63f3541939afb8f37c72748ea/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:04.793053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:04.793344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:04.793675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:04.830791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] MFA Rules not processed for user `5c5db3b63f3541939afb8f37c72748ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:04.835385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:05.082825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 861/1739] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:05.087398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:05.340188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:05.360162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccee8-4e68-4eb5-b03b-d17bfb0c265d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:05.392846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:05.393501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:05.393784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:05.394073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:05.394772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:05.396754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:05.562108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 879/1740] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:05 2022] POST /identity/v3/projects => generated 367 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:05.566189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:05.581137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a84a28-b8d0-465c-92d3-5e483277e550 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:05.716566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:05.718134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:05.718499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:05.718872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:05.719808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:05.722043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:05.952156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 862/1741] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:05 2022] POST /identity/v3/users => generated 290 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:05.955939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:05.976542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69862295-c8f7-402e-9589-1fd35842b8dc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:05.988689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:05.989839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:05.990281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:05.992174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:05.993351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:05.995667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.027757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 880/1742] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:06.032264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.043107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d54094-27cf-4069-a425-67e161fb4575 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.066076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.068745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.075902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.075902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] PATH_INFO: `/v3/projects/8e01c5590dda4d94a09e373dabf2d981/users/fcb255772b774debbf41afa5e2640b4c/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.118356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e01c5590dda4d94a09e373dabf2d981, user_id=fcb255772b774debbf41afa5e2640b4c, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.124870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.261028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 863/1743] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:06 2022] PUT /identity/v3/projects/8e01c5590dda4d94a09e373dabf2d981/users/fcb255772b774debbf41afa5e2640b4c/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:06.265991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.291090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8be2-4976-49ab-bcfb-fabc233643da admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.293559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.295849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.438777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.439782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.440159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.441589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.442703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.445470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.447577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560542-43f7-4ce3-b035-f9cdd2d50eba admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.459314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 881/1744] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:06.467923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.467923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.467923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.467923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] PATH_INFO: `/v3/projects/53514ef4208848abb64b46edabb7ed6a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.468341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53514ef4208848abb64b46edabb7ed6a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.471185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.483577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.496859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:06.512104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28133-4935-4321-8128-889ee6c4a88c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.530254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.531537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.532045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.532477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] PATH_INFO: `/v3/projects/8e01c5590dda4d94a09e373dabf2d981/users/fcb255772b774debbf41afa5e2640b4c/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.534672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e01c5590dda4d94a09e373dabf2d981, user_id=fcb255772b774debbf41afa5e2640b4c, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.539657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f117-4ce3-41ae-8e80-07177c6a9f65 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.554604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 882/1745] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:06 2022] PUT /identity/v3/projects/8e01c5590dda4d94a09e373dabf2d981/users/fcb255772b774debbf41afa5e2640b4c/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:06.568520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.572017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.572017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.625118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53514ef4208848abb64b46edabb7ed6a', 'request_id': 'req-f0ca249f-a949-4778-a3f4-d595e48e39d4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:06.648588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53514ef4208848abb64b46edabb7ed6a', 'request_id': 'req-f0ca249f-a949-4778-a3f4-d595e48e39d4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:06.653656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] MFA Rules not processed for user `fcb255772b774debbf41afa5e2640b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:06.658256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.662674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53514ef4208848abb64b46edabb7ed6a', 'request_id': 'req-f0ca249f-a949-4778-a3f4-d595e48e39d4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:06.734924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] The token cache is being invalidate because project 53514ef4208848abb64b46edabb7ed6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:06.735382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:06.739647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:06.739647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 864/1746] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:06 2022] DELETE /identity/v3/projects/53514ef4208848abb64b46edabb7ed6a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:06.742417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.743808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.756936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 883/1747] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:06.770864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:06.774017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:06.847604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca249f-a949-4778-a3f4-d595e48e39d4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.852971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.853754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.854033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.854309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] PATH_INFO: `/v3/users/76f05c624474497ca3dd1722b7c64c0d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.855598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f05c624474497ca3dd1722b7c64c0d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.857743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.862967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c286946-65bc-474d-8db3-95b99a85124b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:06.868682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:06.875134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:06.875134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:06.875134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:06.883786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:06.896743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:06.912729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 884/1748] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:07.129604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f05c624474497ca3dd1722b7c64c0d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:07.130495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f05c624474497ca3dd1722b7c64c0d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:07.139887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f05c624474497ca3dd1722b7c64c0d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:07.171050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f05c624474497ca3dd1722b7c64c0d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:07.174463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:07.185315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6647af-9ce7-4afe-9d29-63d5f9ff53be service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:07.190004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:07.190496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:07.191010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:07.191383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:07.193496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:07.260005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d50b01ea-1e4a-4fe9-8f91-cad9c0ed5a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f05c624474497ca3dd1722b7c64c0d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:07.266116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:07.267707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba33cd-aa36-4d65-a4b7-66bd3f44de33 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:07.280707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 885/1749] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:07.296863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 865/1750] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:06 2022] DELETE /identity/v3/users/76f05c624474497ca3dd1722b7c64c0d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:07.664118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:07.664947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:07.665418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:07.667186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 886/1751] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:11:07.706010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:07.706596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:07.712272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:07.744087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:07.745552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:07.839904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 866/1752] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:11:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:07.889190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:07.895092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:07.910689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e75d-5854-4c99-8d50-ceb601f10a39 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:07.916266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:07.917956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:07.917956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:07.917956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:07.927109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:07.928702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36a182-9aa4-4a8b-ae9d-782488d4b2f7 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:07.943908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 887/1753] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:08.163021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:08.485152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:08.486601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:08.557073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2752e-a28d-4a37-a9f8-cb7efd4efa83 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:08.562353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:08.563038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:08.563317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:08.563685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] PATH_INFO: `/v3/projects/0bbdf634edb74cf18dec7d166feec40c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:08.564787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbdf634edb74cf18dec7d166feec40c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:08.566689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:08.715023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbdf634edb74cf18dec7d166feec40c', 'request_id': 'req-ab1715ae-648a-46d5-afbe-c3aab8cd9251'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:08.722520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbdf634edb74cf18dec7d166feec40c', 'request_id': 'req-ab1715ae-648a-46d5-afbe-c3aab8cd9251'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:08.728595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbdf634edb74cf18dec7d166feec40c', 'request_id': 'req-ab1715ae-648a-46d5-afbe-c3aab8cd9251'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:08.817970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] The token cache is being invalidate because project 0bbdf634edb74cf18dec7d166feec40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:08.819739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:08.823220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ab1715ae-648a-46d5-afbe-c3aab8cd9251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:08.830196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 867/1754] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:08 2022] DELETE /identity/v3/projects/0bbdf634edb74cf18dec7d166feec40c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:08.835618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:08.835618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:08.835618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:08.863222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:08.864677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:08.952305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 888/1755] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:08.953680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:08.953958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:08.954395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:08.977892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:08.979170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:08.990905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 868/1756] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:08.995175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.021215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a954f1-1425-4bab-97c4-365ac8385591 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.021215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.021215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.021215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.021673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.021673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:09.021673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.023809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.042444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 889/1757] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:09.044495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.059416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4822c-bead-43c0-aa6b-2eeefe9a46ad None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.066589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.067490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.068756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.069732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.070910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.073291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.164998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 869/1758] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:09.166331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.182268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4134c-15b9-42a1-b680-c5c71faa5484 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.279935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.286542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.286542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.286542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.286542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.286542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.345831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:09.412487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 890/1759] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:09 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:09.416434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.448416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98336d38-5366-4225-91cf-ba08958e6031 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.458219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.460298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.460298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.460298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.460298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.462034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.483856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.488768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 870/1760] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:09.493399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f689a6d-360b-47c4-b292-cb73483324f6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.501593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.502808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.503257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.503672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.504782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.506557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159d4c-3400-45ee-a2f0-0dbf0bd5770e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.523460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 891/1761] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:09.527337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.538861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17825-caeb-4de9-ab1a-62c723870e3f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.544967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.546749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.546749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.546749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] PATH_INFO: `/v3/projects/c9f88b5fd6974be89f262ea2f4e26dc0/users/8eaceac80d5b4aaab365263e15b3f0dd/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.564016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f88b5fd6974be89f262ea2f4e26dc0, user_id=8eaceac80d5b4aaab365263e15b3f0dd, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.567106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:09.665018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 871/1762] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:09 2022] PUT /identity/v3/projects/c9f88b5fd6974be89f262ea2f4e26dc0/users/8eaceac80d5b4aaab365263e15b3f0dd/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:09.677048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.677769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.677769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.733194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] MFA Rules not processed for user `8eaceac80d5b4aaab365263e15b3f0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:09.734427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:09.840475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 892/1763] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:09.850524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:09.923157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080aa32-c42c-45ad-93b7-f5ad6f194ed6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:09.928541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:09.929463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:09.929906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:09.930338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:09.931368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:09.933588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.092424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 872/1764] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:09 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:10.094644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:10.096428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.111282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17052d29-554b-48c8-9abb-c26e2a143488 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.198108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.199107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.199391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.199675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.201071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:10.203826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.311581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 893/1765] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:10 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:10.317228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.339215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa80b4e-51cd-41f2-a9fb-d54903369926 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.342668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.343401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.344019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.344019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.344821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:10.346965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.362145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 873/1766] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:10.366070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.378031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd5572-ed48-44de-9add-f8e3e5b3e199 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.382650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.383390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.383666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.383937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] PATH_INFO: `/v3/projects/a394f6b443e64bffb48a7ff320e52527/users/6908b72468b543c7b1592af884810c1d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.400899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394f6b443e64bffb48a7ff320e52527, user_id=6908b72468b543c7b1592af884810c1d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:10.404287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.504834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 894/1767] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:10 2022] PUT /identity/v3/projects/a394f6b443e64bffb48a7ff320e52527/users/6908b72468b543c7b1592af884810c1d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:10.509159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.525910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46b2c-d5fc-42a1-a416-51dafc640553 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.615751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.616603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.617484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.617946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.619358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:10.621243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff77ec-d116-40f8-ad68-bb090485c85e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.635382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 874/1768] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:10.640579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.651790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d7f-9951-47c7-b3ed-64dab9e86b42 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.656908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.657680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.658037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.658466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] PATH_INFO: `/v3/projects/a394f6b443e64bffb48a7ff320e52527/users/6908b72468b543c7b1592af884810c1d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.660588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394f6b443e64bffb48a7ff320e52527, user_id=6908b72468b543c7b1592af884810c1d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:10.663616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:10.681530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 895/1769] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:10 2022] PUT /identity/v3/projects/a394f6b443e64bffb48a7ff320e52527/users/6908b72468b543c7b1592af884810c1d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:10.708274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f745-a238-47a2-a06a-2e469b39a8dc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.708274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f745-a238-47a2-a06a-2e469b39a8dc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.708274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f745-a238-47a2-a06a-2e469b39a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:10.731029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3009f745-a238-47a2-a06a-2e469b39a8dc None None] MFA Rules not processed for user `6908b72468b543c7b1592af884810c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:10.733644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3009f745-a238-47a2-a06a-2e469b39a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:10.843366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 875/1770] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:10.854282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:10.856168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:10.940895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd06840-0d78-4eb3-8c12-cd11e4944398 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:10.945203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:10.946080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:10.946526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:10.946968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:11.034111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:11.035610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62161156-62b7-46b4-9317-24877cf232db service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:11.045604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 896/1771] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:11.500224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:12.554546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:12.556075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:12.556512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:12.558216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 876/1772] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:11:12.575339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:12.576207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:12.576964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:12.601422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:12.608587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:12.687490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 897/1773] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:11:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:12.711452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:12.716425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:12.743918 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf92ff-c474-4c7b-add7-045ed40821e1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:12.756743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:12.757485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:12.778272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:12.781326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:12.796692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:12.798417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d602f96-22b1-491f-992f-8574702e59fe service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:12.811722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 877/1774] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:13.304828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:13.544634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:14.959623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:14.961469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:15.055586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e45fb6-51c0-47ba-aa0d-ef3b2eeab6d8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:15.062407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:15.063565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:15.064029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:15.067486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] PATH_INFO: `/v3/users/5c5db3b63f3541939afb8f37c72748ea` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:15.067486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5db3b63f3541939afb8f37c72748ea)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:15.069345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:15.317262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5db3b63f3541939afb8f37c72748ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:15.325545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5db3b63f3541939afb8f37c72748ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:15.325545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5db3b63f3541939afb8f37c72748ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:15.343478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5db3b63f3541939afb8f37c72748ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:15.374217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:15.457775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5db3b63f3541939afb8f37c72748ea'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:15.478887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 898/1775] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:14 2022] DELETE /identity/v3/users/5c5db3b63f3541939afb8f37c72748ea => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:15.483394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:15.483920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:15.489195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:15.535858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:15.537338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:15.617936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 878/1776] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:15.629683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:15.631126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:15.692522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0747f-6a0d-4d63-a5f9-66a2f8d4eca7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:15.696266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:15.704627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:15.704627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:15.710902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:15.724651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:15.726090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:15.737178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 899/1777] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:15.923669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:16.335540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:16.337055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:16.355879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1794062-3fca-48a4-9134-5996ad856113 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:16.361398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:16.362461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:16.362742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:16.363023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] PATH_INFO: `/v3/projects/2a91cc246a34454ab6b91a192a4fac75` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:16.364220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a91cc246a34454ab6b91a192a4fac75)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:16.366488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:16.493881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a91cc246a34454ab6b91a192a4fac75', 'request_id': 'req-9a8282b9-d193-4ac3-9fed-1186da3e4673'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.502277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a91cc246a34454ab6b91a192a4fac75', 'request_id': 'req-9a8282b9-d193-4ac3-9fed-1186da3e4673'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.508704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a91cc246a34454ab6b91a192a4fac75', 'request_id': 'req-9a8282b9-d193-4ac3-9fed-1186da3e4673'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.598523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] The token cache is being invalidate because project 2a91cc246a34454ab6b91a192a4fac75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:16.598881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.599812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.602818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 879/1778] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:16 2022] DELETE /identity/v3/projects/2a91cc246a34454ab6b91a192a4fac75 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:16.607109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:16.642280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:16.657178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2022-2594-4193-9680-95cf3464e1cb service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:16.657286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:16.729421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8282b9-d193-4ac3-9fed-1186da3e4673 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:16.734363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:16.735048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:16.735325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:16.735595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] PATH_INFO: `/v3/users/fcb255772b774debbf41afa5e2640b4c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:16.736352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:16.736897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb255772b774debbf41afa5e2640b4c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:16.737095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:16.737603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:16.738081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:16.738870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:16.740230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:16.832661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:16.832661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:16.839279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 880/1779] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:16.974045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb255772b774debbf41afa5e2640b4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.976099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb255772b774debbf41afa5e2640b4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:16.977559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb255772b774debbf41afa5e2640b4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:17.015370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb255772b774debbf41afa5e2640b4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:17.140471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-af4dfaf1-acf9-47c7-86bb-fc45ca11a97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb255772b774debbf41afa5e2640b4c'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:17.158020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 900/1780] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:16 2022] DELETE /identity/v3/users/fcb255772b774debbf41afa5e2640b4c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:18.029924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:18.043424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:18.067469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05446f-ca7f-4b4c-97d2-994462862ec1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:18.129763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:18.130414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.130690 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.131004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] PATH_INFO: `/v3/projects/8e01c5590dda4d94a09e373dabf2d981` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.132180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e01c5590dda4d94a09e373dabf2d981)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:18.134146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:18.365620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e01c5590dda4d94a09e373dabf2d981', 'request_id': 'req-4916eb2e-896f-41cc-bfe8-062c885e7919'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:18.373430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e01c5590dda4d94a09e373dabf2d981', 'request_id': 'req-4916eb2e-896f-41cc-bfe8-062c885e7919'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:18.379517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e01c5590dda4d94a09e373dabf2d981', 'request_id': 'req-4916eb2e-896f-41cc-bfe8-062c885e7919'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:18.457606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] The token cache is being invalidate because project 8e01c5590dda4d94a09e373dabf2d981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:18.457606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:18.458630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4916eb2e-896f-41cc-bfe8-062c885e7919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:18.461331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 881/1781] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:18 2022] DELETE /identity/v3/projects/8e01c5590dda4d94a09e373dabf2d981 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:18.469068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.480065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.480352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.528671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:18.530130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:18.618044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 901/1782] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:18.619862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.620152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.620431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.642975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:18.643549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:18.652544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 882/1783] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:18.665591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:18.676893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95237356-bab4-49bc-983c-a1cd8194863b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:18.682958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:18.683852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.684310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.684727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.685728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:18.686158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:18.687884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:18.714750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 902/1784] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:18.717201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:18.726507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b52029-7f60-4574-9481-e9dbb391945c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:18.732546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:18.733190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.733457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.733732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.734410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:18.736369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:18.843763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 883/1785] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:18 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:18.847987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:18.858238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fa69-f30a-4098-ba49-4064e50e99f6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:18.915847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:18.916528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:18.921434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:18.921434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:18.921434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:18.921434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:18.996384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 903/1786] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:18 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:18.999494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.009985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2b41-cffc-4398-a25d-9c3260ae54c3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.015822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.022395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.022395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.022395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.022395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.022395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.032648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 884/1787] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:19.034524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.046052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd311-fb33-44f7-af2a-79c6177ae0b0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.051115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.051666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.051946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.052225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.053027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.054628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd10f8-a800-4738-a122-47192795eaeb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.066951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 904/1788] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:19.071554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.082206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309feeb-752d-4d7c-ab72-2a61aca035c0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.087850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.088632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.088987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.089337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] PATH_INFO: `/v3/projects/5ea0a87788984983a23f35da008ec103/users/65928ad98b214da8be0baf23f617750a/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.110521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea0a87788984983a23f35da008ec103, user_id=65928ad98b214da8be0baf23f617750a, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.113708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.252629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 885/1789] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:19 2022] PUT /identity/v3/projects/5ea0a87788984983a23f35da008ec103/users/65928ad98b214da8be0baf23f617750a/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:19.263010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.263237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.263519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.291248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] MFA Rules not processed for user `65928ad98b214da8be0baf23f617750a`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:19.292485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:19.363393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 905/1790] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:19.368905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.438997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b49216-e8ec-4654-abf1-b06ebe831fbe admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.444582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.445304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.445578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.446185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.446646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.448275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:19.448489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.579543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 886/1791] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:19 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:19.586125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.598146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6ce0-e599-4c6a-83ad-07a36457431b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.711126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.711778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.712063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.712342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.713034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.725785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.891077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 906/1792] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:19 2022] POST /identity/v3/users => generated 298 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:19.891926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.903174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082db15-26d0-4464-9a88-d69e4b724835 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.911593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.916016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.916016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.916016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.916016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.916825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:19.933764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 887/1793] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:19.945127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:19.960438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85ec39-c6e4-4a11-bf58-6de592a61321 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:19.967611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:19.968385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:19.970942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:19.970942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] PATH_INFO: `/v3/projects/79caa8f911f14867813161f9ef85620d/users/2d283aa878b945748d5c64cea709f63e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:19.989908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79caa8f911f14867813161f9ef85620d, user_id=2d283aa878b945748d5c64cea709f63e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:19.994225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.103785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 907/1794] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:19 2022] PUT /identity/v3/projects/79caa8f911f14867813161f9ef85620d/users/2d283aa878b945748d5c64cea709f63e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:20.105649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.124460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a13ef-204b-4ddf-8192-da41a88ab453 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.202526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.205520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.205921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.210223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.210223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.210223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796961bc-6930-4d8b-ba88-1b300b6ed0e2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.226534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 888/1795] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:20.227860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.255497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215f0de-b9ca-4579-af09-978ab0359ee1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.296592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.296592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.296592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.296592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] PATH_INFO: `/v3/projects/79caa8f911f14867813161f9ef85620d/users/2d283aa878b945748d5c64cea709f63e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.299897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=79caa8f911f14867813161f9ef85620d, user_id=2d283aa878b945748d5c64cea709f63e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.303759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.315057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:20.335574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 908/1796] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:20 2022] PUT /identity/v3/projects/79caa8f911f14867813161f9ef85620d/users/2d283aa878b945748d5c64cea709f63e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:20.350052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.350934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.351221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.383357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] MFA Rules not processed for user `2d283aa878b945748d5c64cea709f63e`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:20.384790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.487547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 889/1797] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:20.500650 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.503580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.586144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42253-cf4c-4fdb-b14d-dc58ae5bd8db admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.591944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.592952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.593234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.593579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.604137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.605874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.620025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 909/1798] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:20.804534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:20.806104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:20.818579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b957-21ef-4bba-b2dc-10e6f9797506 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:20.822326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:20.823135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:20.823417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:20.823694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:20.882517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:20.888114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013904a4-c5d6-44e6-b813-7d5e99d62251 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:20.899012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 890/1799] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:21.447139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:21.542160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1838139-dd2e-4238-8362-2b5cfad0c084 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:21.548478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:21.549227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:21.549576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:21.549965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] PATH_INFO: `/v3/users/65928ad98b214da8be0baf23f617750a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:21.551559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65928ad98b214da8be0baf23f617750a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:21.553604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:21.775696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65928ad98b214da8be0baf23f617750a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:21.776810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65928ad98b214da8be0baf23f617750a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:21.777505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65928ad98b214da8be0baf23f617750a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:21.798800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65928ad98b214da8be0baf23f617750a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:21.937398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65928ad98b214da8be0baf23f617750a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:21.958489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 910/1800] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:21 2022] DELETE /identity/v3/users/65928ad98b214da8be0baf23f617750a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:21.963120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:21.963554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:21.963655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:21.987894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:21.989832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:22.056429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 891/1801] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:22.066913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:22.068485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:22.131668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881df27-6df5-4a90-be36-583de835cd8d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:22.136641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:22.137902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:22.138284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:22.138661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:22.162621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:22.164837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:22.175551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 911/1802] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:22.182496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:22.741749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:22.744117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:22.768485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c9c9-2972-4b20-80ed-c3b6736705f9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:22.768485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:22.768485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:22.768485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:22.768873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] PATH_INFO: `/v3/projects/5ea0a87788984983a23f35da008ec103` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:22.769695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea0a87788984983a23f35da008ec103)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:22.773149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:22.938799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea0a87788984983a23f35da008ec103', 'request_id': 'req-ec71c431-0344-4b72-96d5-b7c202141744'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:22.946029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea0a87788984983a23f35da008ec103', 'request_id': 'req-ec71c431-0344-4b72-96d5-b7c202141744'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:22.952951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea0a87788984983a23f35da008ec103', 'request_id': 'req-ec71c431-0344-4b72-96d5-b7c202141744'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.099116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] The token cache is being invalidate because project 5ea0a87788984983a23f35da008ec103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:23.099779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.100189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.102094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 892/1803] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:22 2022] DELETE /identity/v3/projects/5ea0a87788984983a23f35da008ec103 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:23.106250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:23.118653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8b08-0576-4d1b-8eee-dffd048e15cc service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:23.202417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:23.203102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:23.203465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:23.203740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] PATH_INFO: `/v3/users/2d283aa878b945748d5c64cea709f63e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:23.204955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d283aa878b945748d5c64cea709f63e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:23.206911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:23.442350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d283aa878b945748d5c64cea709f63e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.443294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d283aa878b945748d5c64cea709f63e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.444021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d283aa878b945748d5c64cea709f63e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.457779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d283aa878b945748d5c64cea709f63e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.565595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d283aa878b945748d5c64cea709f63e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:23.585205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 912/1804] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:23 2022] DELETE /identity/v3/users/2d283aa878b945748d5c64cea709f63e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:23.935373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:24.457696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:24.459258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:24.466522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:24.468536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:24.491522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71c431-0344-4b72-96d5-b7c202141744 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:24.595397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:24.596061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:24.596340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:24.596613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] PATH_INFO: `/v3/users/8eaceac80d5b4aaab365263e15b3f0dd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:24.599435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eaceac80d5b4aaab365263e15b3f0dd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:24.601385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:24.627318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1792c-f3e8-421f-b3f4-400d57759ee0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:24.634259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:24.635514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:24.636022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:24.636510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] PATH_INFO: `/v3/projects/79caa8f911f14867813161f9ef85620d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:24.638158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79caa8f911f14867813161f9ef85620d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:24.640733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:24.890568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eaceac80d5b4aaab365263e15b3f0dd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:24.891366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eaceac80d5b4aaab365263e15b3f0dd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:24.899272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eaceac80d5b4aaab365263e15b3f0dd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:24.900154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79caa8f911f14867813161f9ef85620d', 'request_id': 'req-a76575bc-ec50-4772-8bad-598fc44f344e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:24.912762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eaceac80d5b4aaab365263e15b3f0dd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:24.916975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79caa8f911f14867813161f9ef85620d', 'request_id': 'req-a76575bc-ec50-4772-8bad-598fc44f344e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.008576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-be414467-d5c2-4c97-aa62-ec246ec3dbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eaceac80d5b4aaab365263e15b3f0dd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.027160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 893/1805] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:24 2022] DELETE /identity/v3/users/8eaceac80d5b4aaab365263e15b3f0dd => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:25.031437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf360d5-ce6b-4277-8e65-bcd7b038e8f0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.032129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf360d5-ce6b-4277-8e65-bcd7b038e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.032614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf360d5-ce6b-4277-8e65-bcd7b038e8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.055009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-baf360d5-ce6b-4277-8e65-bcd7b038e8f0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:25.056292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-baf360d5-ce6b-4277-8e65-bcd7b038e8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.069049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:25.102676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79caa8f911f14867813161f9ef85620d', 'request_id': 'req-a76575bc-ec50-4772-8bad-598fc44f344e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.125365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] The token cache is being invalidate because project 79caa8f911f14867813161f9ef85620d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:25.125677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.127788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.134414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 913/1806] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:24 2022] DELETE /identity/v3/projects/79caa8f911f14867813161f9ef85620d => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:25.140664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.140664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.154897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 894/1807] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:25.156073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.156943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.157399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.207364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:25.225498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.236460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 895/1808] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:25.237524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.246631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.296963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76575bc-ec50-4772-8bad-598fc44f344e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.330319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.331145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.331614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.332993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] PATH_INFO: `/v3/users/ad5e482f666f4e2f90f810790bfd67b6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.336541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5e482f666f4e2f90f810790bfd67b6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.341897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.352061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2f912-a194-4ff3-a3c8-bd0f2544eb3d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.358084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.358913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.359199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.359497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.409656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.412844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e781dd-196e-4b1a-be48-cf19d9d7e611 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.425568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 896/1809] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:25.427887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.428344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.440342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.475720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:25.477862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.489241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 897/1810] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:25.494186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.507567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c99be-d80e-4a5c-8d1c-67a8ad266d06 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.513447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.514815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.515305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.515802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.516927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:25.517447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.519476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.555548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 898/1811] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:25.556685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.580107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3374-54ab-45b8-b76e-2cbaf220b230 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.587150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.588795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.588795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.588795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.589723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.592045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.615289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5e482f666f4e2f90f810790bfd67b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.617171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5e482f666f4e2f90f810790bfd67b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.617900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5e482f666f4e2f90f810790bfd67b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.648494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5e482f666f4e2f90f810790bfd67b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.741882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 899/1812] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:25.744076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.747404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.749176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9cdbe7d3-74f3-491f-acd1-de5244499262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5e482f666f4e2f90f810790bfd67b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:25.766098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 914/1813] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:25 2022] DELETE /identity/v3/users/ad5e482f666f4e2f90f810790bfd67b6 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:25.770458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.770776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.771061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.826517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:25.827839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:25.848274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7f98a-6412-463d-af35-31c90634892f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:25.938641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:25.939679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:25.940737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:25.945338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 915/1814] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:25.951265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:25.951265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:25.958759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:25.976168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:25.978467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.086499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 900/1815] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:25 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:26.088180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.099877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5d65-6f22-4738-b3f5-87426f577636 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.105177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcaf9e-d637-4b4d-93e5-8b18f9fcf1fc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.116606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.117031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.119011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.119101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.119555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.120030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.120308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.120824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.123687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.139845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.154021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.155715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.166398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 901/1816] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:26.171727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.183517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdd584-908f-4862-bd67-84a517a46da5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.186112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 916/1817] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:26.198588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.199521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.199740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.200691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.201427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.203982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab647c-74a3-4679-84fe-6eafa33f8070 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.216656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 902/1818] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:26.221044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.227987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:26.246227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5e3d-afce-4a7e-80de-db0333833639 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.254747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.254747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.254747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.254747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] PATH_INFO: `/v3/projects/b2f0afde82b84975a92f3ad02fcc3a9b/users/5b3140a6547d4865a99ae7627b0d426f/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.273844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f0afde82b84975a92f3ad02fcc3a9b, user_id=5b3140a6547d4865a99ae7627b0d426f, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.276567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.366046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 917/1819] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:26 2022] PUT /identity/v3/projects/b2f0afde82b84975a92f3ad02fcc3a9b/users/5b3140a6547d4865a99ae7627b0d426f/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:26.377967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.378251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.378528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.411785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.414266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.416434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] MFA Rules not processed for user `5b3140a6547d4865a99ae7627b0d426f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:26.418037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.502416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6de64-bca9-48d2-a3f2-d483fe7cc0a7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.508008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.508258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.508571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.508849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] PATH_INFO: `/v3/projects/c9f88b5fd6974be89f262ea2f4e26dc0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.510154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f88b5fd6974be89f262ea2f4e26dc0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.512950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.540320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 903/1820] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:26.547989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.549379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:26.613402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb61c-b4e8-4b23-9bae-52cf8ab36436 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.620757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.620757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.620757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.620757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.628531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.637993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:26.650567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 904/1821] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:26.654805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f88b5fd6974be89f262ea2f4e26dc0', 'request_id': 'req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.661184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f88b5fd6974be89f262ea2f4e26dc0', 'request_id': 'req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.725887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f88b5fd6974be89f262ea2f4e26dc0', 'request_id': 'req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.740518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] The token cache is being invalidate because project c9f88b5fd6974be89f262ea2f4e26dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:26.740823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.741510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:26.746914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 918/1822] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:26 2022] DELETE /identity/v3/projects/c9f88b5fd6974be89f262ea2f4e26dc0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:26.748162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:26.762005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439afb2-0661-4b3e-b353-ab8cccc50fc1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:26.827415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:26.828071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:26.828349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:26.828623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] PATH_INFO: `/v3/users/6908b72468b543c7b1592af884810c1d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:26.829828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6908b72468b543c7b1592af884810c1d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:26.831797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.062858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.064537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.086910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abec1c-dac6-458b-8ef7-bf7bc66c92ee admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.092652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.093461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.093744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.094018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] PATH_INFO: `/v3/projects/54d9c6954dfa4078b9c7d7ebc4a528e4` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.095404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d9c6954dfa4078b9c7d7ebc4a528e4)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.105770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.122996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6908b72468b543c7b1592af884810c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.123989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6908b72468b543c7b1592af884810c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.138315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6908b72468b543c7b1592af884810c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.151201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6908b72468b543c7b1592af884810c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.228770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6908b72468b543c7b1592af884810c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.238364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 905/1823] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:26 2022] DELETE /identity/v3/users/6908b72468b543c7b1592af884810c1d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:27.244511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d9c6954dfa4078b9c7d7ebc4a528e4', 'request_id': 'req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.259718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d9c6954dfa4078b9c7d7ebc4a528e4', 'request_id': 'req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.396633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d9c6954dfa4078b9c7d7ebc4a528e4', 'request_id': 'req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.412199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] The token cache is being invalidate because project 54d9c6954dfa4078b9c7d7ebc4a528e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:27.412199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.412898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.417793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 919/1824] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:27 2022] DELETE /identity/v3/projects/54d9c6954dfa4078b9c7d7ebc4a528e4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:27.420124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.421670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.428057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:27.508955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea009fb-07bd-4c86-aecb-c0b8df4903b1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.510110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.511056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.511492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.511896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] PATH_INFO: `/v3/users/27175f4771f34bc2b4a18cc1e2b87da4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.513797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27175f4771f34bc2b4a18cc1e2b87da4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.516200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:27.642216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:27.713112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27175f4771f34bc2b4a18cc1e2b87da4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.713763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27175f4771f34bc2b4a18cc1e2b87da4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.721519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27175f4771f34bc2b4a18cc1e2b87da4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.734087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27175f4771f34bc2b4a18cc1e2b87da4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.797455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:27.798541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:27.817652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d2a81b6d-c514-4a02-a3cf-765e6f700572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27175f4771f34bc2b4a18cc1e2b87da4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:27.829151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 906/1825] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:27 2022] DELETE /identity/v3/users/27175f4771f34bc2b4a18cc1e2b87da4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:27.874993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fa11f-1da9-4e3c-b84c-d9d9a08720a2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:27.936299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:27.936937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:27.937214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:27.937490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] PATH_INFO: `/v3/projects/a394f6b443e64bffb48a7ff320e52527` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:27.938644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a394f6b443e64bffb48a7ff320e52527)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:27.940600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.071749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a394f6b443e64bffb48a7ff320e52527', 'request_id': 'req-49196043-c866-4a8b-a5c4-93b3b9e1da1d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.077593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a394f6b443e64bffb48a7ff320e52527', 'request_id': 'req-49196043-c866-4a8b-a5c4-93b3b9e1da1d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.146573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a394f6b443e64bffb48a7ff320e52527', 'request_id': 'req-49196043-c866-4a8b-a5c4-93b3b9e1da1d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.165426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] The token cache is being invalidate because project a394f6b443e64bffb48a7ff320e52527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:28.165712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.166381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.167933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 920/1826] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:27 2022] DELETE /identity/v3/projects/a394f6b443e64bffb48a7ff320e52527 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:28.174557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7fd3-edc9-4b92-b08a-f4af5e8cbc05 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.174866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7fd3-edc9-4b92-b08a-f4af5e8cbc05 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.175146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7fd3-edc9-4b92-b08a-f4af5e8cbc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.194991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8dcf7fd3-edc9-4b92-b08a-f4af5e8cbc05 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.198267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8dcf7fd3-edc9-4b92-b08a-f4af5e8cbc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.235980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.237891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.265644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 907/1827] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:28.277756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.278740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.279124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.302517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.303702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.312860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 908/1828] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:28.315692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196043-c866-4a8b-a5c4-93b3b9e1da1d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.316732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.323660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.326366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.326366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.326366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] PATH_INFO: `/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.327200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451c7a8-41ff-49ad-972b-925ce27dacac None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.327797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9aa1b1b8b34a119e1a0f86ea184c2d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.330077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.332398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.333148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.333443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.333720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.334424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:28.334751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.336394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.355185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 909/1829] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:28.356990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.368065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c000e9-733b-4626-9b6e-cebf6b8c2a8c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.375645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.376500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.376747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.377251 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.378038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.380059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.456172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 910/1830] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:28.460350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.467684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9aa1b1b8b34a119e1a0f86ea184c2d', 'request_id': 'req-d539555a-abf0-4e4a-912c-5b35ae59ca49'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.473047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9aa1b1b8b34a119e1a0f86ea184c2d', 'request_id': 'req-d539555a-abf0-4e4a-912c-5b35ae59ca49'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.525496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e298-feab-4d0d-bc81-c83df1a7e1c2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.531700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.532281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.532616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.532935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.533589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.535671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.585379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9aa1b1b8b34a119e1a0f86ea184c2d', 'request_id': 'req-d539555a-abf0-4e4a-912c-5b35ae59ca49'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.599335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] The token cache is being invalidate because project 5d9aa1b1b8b34a119e1a0f86ea184c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:28.599688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.600336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d539555a-abf0-4e4a-912c-5b35ae59ca49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:28.605387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 921/1831] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:28 2022] DELETE /identity/v3/projects/5d9aa1b1b8b34a119e1a0f86ea184c2d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:28.608134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cf494-235a-4130-a3f5-53d512e4c9a3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.608466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cf494-235a-4130-a3f5-53d512e4c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.609231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cf494-235a-4130-a3f5-53d512e4c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.617622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 911/1832] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:28.622501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.624442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.632841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-977cf494-235a-4130-a3f5-53d512e4c9a3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.634296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-977cf494-235a-4130-a3f5-53d512e4c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.641575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c1401-92b4-4fec-9122-52b99851b2c0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.651024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.651831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.652225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.652574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.654100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 922/1833] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:28.654382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.655544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.655835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.656115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.656832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.673792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 912/1834] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:28.674646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.679166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.681739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.698884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 923/1835] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:28.700351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.709931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe3d3-46a7-4e0c-84f6-aa1cb7053e27 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.711069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb8e2d-aa8a-48d9-9a76-2d81da53d144 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.714980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:28.718217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.719105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.721894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.721894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.721894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.721894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.722375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.722375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.722375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.723164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:28.723542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.725552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.728672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.741804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 924/1836] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:28.744985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 913/1837] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:28.757591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.757781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.768428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187568c9-f1da-4861-8122-86558b6f6fe7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.769291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5f73b-e6a3-4163-ab21-6d5a04db18f4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.773942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.774634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.774993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.775323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.776017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.777080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.778752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.779017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.779353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.779693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] PATH_INFO: `/v3/projects/badc8a1baed6416da0ecc280b07a4c44/users/b94ebcf38d1c4183bfc515a28152dbd5/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.796010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badc8a1baed6416da0ecc280b07a4c44, user_id=b94ebcf38d1c4183bfc515a28152dbd5, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.798761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f50c-b4b2-48ee-af96-260fcb48e3b5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.855217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 914/1838] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:28 2022] PUT /identity/v3/projects/badc8a1baed6416da0ecc280b07a4c44/users/b94ebcf38d1c4183bfc515a28152dbd5/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:28.860964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.861250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.861525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.877093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 925/1839] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:28.880633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:28.893869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:28.895331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:28.964170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fb0f6-d2ee-481d-9ada-bf1e7e00bfbc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:28.969039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:28.970495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:28.970495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:28.970495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:28.971132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:28.973117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:28.983068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 915/1840] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:28.995860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.010448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:29.075721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff274f4-9206-4076-8eb2-af396992e64f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.079872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.080488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.080767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.081071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.091062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.092599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.116519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 916/1841] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:29.134630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.135733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 926/1842] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:28 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:29.148422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b78e3-901c-4ad8-a28f-7b917b5d789c service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.158936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.162485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.162861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.163084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.163890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.167656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.179501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 917/1843] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:29.184143 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.196113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0f59c-e009-41ea-a99c-f934c0d80407 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.201411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.202045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.202331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.202606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.203356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.205714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce395689-e74f-4a36-a8cc-ff5d965ef7fc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.221338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 927/1844] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:29.230252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.241086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cad8a-9b98-4017-8e43-c9f364fae815 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.248285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.249854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.249854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.249854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] PATH_INFO: `/v3/projects/1a96793480704bfcad707d67f1621f83/users/81b43423e52e4e36a352317672424c05/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.266488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a96793480704bfcad707d67f1621f83, user_id=81b43423e52e4e36a352317672424c05, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.270071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.359168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 918/1845] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:29 2022] PUT /identity/v3/projects/1a96793480704bfcad707d67f1621f83/users/81b43423e52e4e36a352317672424c05/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:29.369960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.370248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.370522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.399895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] MFA Rules not processed for user `81b43423e52e4e36a352317672424c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:29.401155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:29.476220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 928/1846] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:29.477438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.542469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:29.560417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705992-b01f-473b-a608-fed0da163d31 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.568112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.569670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.569986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.570318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.571510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.573493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.694406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 919/1847] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:29 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:29.698420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.710366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db15d-f267-43b1-81df-5e6d339b94ef None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.793307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.794091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.794452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.795082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.795836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.798197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.907485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 929/1848] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:29 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:29.908767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.920413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07cba7-8ec4-40a6-b59d-dda0159e6c8b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.926231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.926904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.927195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.927484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.928165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.929777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:29.941530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 920/1849] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:29.946183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:29.959679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5a740-3623-4221-87de-6b03363ecb5b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:29.965946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:29.967484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:29.967830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:29.968180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] PATH_INFO: `/v3/projects/81451cb49347473e84c59baaa664c49c/users/39c50e05e2b34969b899e39b83241c2f/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:29.992377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=81451cb49347473e84c59baaa664c49c, user_id=39c50e05e2b34969b899e39b83241c2f, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:29.995184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:30.135995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 930/1850] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:29 2022] PUT /identity/v3/projects/81451cb49347473e84c59baaa664c49c/users/39c50e05e2b34969b899e39b83241c2f/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:30.147216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:30.167992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b5ef4-be8a-49d2-a4f6-8d7b174a8b55 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:30.275186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:30.276297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.276768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.277226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.280306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:30.282810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f87bc7-c70e-4eb3-b99f-869344cfe77d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:30.300231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 921/1851] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:30.301366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:30.316627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fdc09-0265-46ff-9559-98887f6443ad admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:30.328262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:30.328959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.329238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.329507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] PATH_INFO: `/v3/projects/81451cb49347473e84c59baaa664c49c/users/39c50e05e2b34969b899e39b83241c2f/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.332801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=81451cb49347473e84c59baaa664c49c, user_id=39c50e05e2b34969b899e39b83241c2f, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:30.348366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:30.363560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 931/1852] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:30 2022] PUT /identity/v3/projects/81451cb49347473e84c59baaa664c49c/users/39c50e05e2b34969b899e39b83241c2f/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:30.376078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35e751-6134-44f1-b786-c76391f94ceb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.376412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35e751-6134-44f1-b786-c76391f94ceb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.376673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35e751-6134-44f1-b786-c76391f94ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.406277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:30.412222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bb35e751-6134-44f1-b786-c76391f94ceb None None] MFA Rules not processed for user `39c50e05e2b34969b899e39b83241c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:30.414797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bb35e751-6134-44f1-b786-c76391f94ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:30.523645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 922/1853] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:30.537879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:30.540923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:30.625455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3d75-2d49-4dba-8a42-698825699ffe admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:30.630643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:30.631430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.631774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.632126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.655620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:30.657131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.657131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.657131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.657382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:30.671256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 932/1854] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:30.738641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] MFA Rules not processed for user `b94ebcf38d1c4183bfc515a28152dbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:30.740452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:30.886456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 923/1855] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:30.944095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:30.946089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:30.967919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97da848-2a4b-43b9-9293-bead95987877 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:30.972154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:30.973088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:30.973951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:30.974577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:30.989356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:30.993282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:30.994882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64a3f-3eec-4462-924f-5ca73696ca18 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:31.003749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09b187-b9d9-4c3e-b8b6-b3ce428d073e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:31.007391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 933/1856] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:31.008208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:31.008848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:31.009131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:31.009410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:31.094002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:31.095547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:31.107705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 924/1857] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:31.655418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:32.623893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:33.006594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:33.006918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:33.007210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:33.026814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] MFA Rules not processed for user `b94ebcf38d1c4183bfc515a28152dbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:33.028185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:33.035906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 934/1858] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:33.108986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:34.859789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:34.882086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:34.883544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:34.995244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a1945-8e41-4772-8ed0-c7d7fe4fd6cb service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.000130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.000776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.001057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.001334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] PATH_INFO: `/v3/users/5b3140a6547d4865a99ae7627b0d426f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.002492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3140a6547d4865a99ae7627b0d426f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.004462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.277966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.288899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bcc05-79e3-4960-89d0-a12afb89e06d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.293629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.294413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.294691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.295014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] PATH_INFO: `/v3/users/81b43423e52e4e36a352317672424c05` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.296221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b43423e52e4e36a352317672424c05)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.298150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.448645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3140a6547d4865a99ae7627b0d426f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.449211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3140a6547d4865a99ae7627b0d426f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.457407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3140a6547d4865a99ae7627b0d426f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.469598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3140a6547d4865a99ae7627b0d426f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.505601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b43423e52e4e36a352317672424c05'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.506288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b43423e52e4e36a352317672424c05'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.506960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b43423e52e4e36a352317672424c05'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.519090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b43423e52e4e36a352317672424c05'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.630372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c850edd6-9438-4602-b2c6-0cd112de212a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3140a6547d4865a99ae7627b0d426f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.637150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 925/1859] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:34 2022] DELETE /identity/v3/users/5b3140a6547d4865a99ae7627b0d426f => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:35.641608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.641941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.642222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.661735 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.662991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.725549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 926/1860] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:35.738051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-afba58e0-4205-47a0-81d1-18914890493f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b43423e52e4e36a352317672424c05'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:35.739166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:35.746629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.749233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.767318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 935/1861] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:35 2022] DELETE /identity/v3/users/81b43423e52e4e36a352317672424c05 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:35.769109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.769399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.769775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.793131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:35.795200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.815972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7852-14f9-4d88-ba90-e75d2d91b488 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.874797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 936/1862] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:35.879496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.880241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.880800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.881033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.884118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:35.885970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:35.891185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.892720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.896960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a85880-404f-42ad-9c98-ee2538fed322 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:35.900824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:35.901434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:35.901765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:35.902039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:35.903342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 927/1863] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:35.912597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:35.914055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:35.924949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 937/1864] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:36.538460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.539971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.554308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe819-ed38-4d9c-ad3a-3b8b37edf5aa service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.560142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.560816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.561091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.561362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] PATH_INFO: `/v3/projects/1a96793480704bfcad707d67f1621f83` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.562529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a96793480704bfcad707d67f1621f83)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.564719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.579156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.581288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.597425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3bd3d-721a-4db9-8fe2-0d55b93b2f93 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.603066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.603722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.609987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.609987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] PATH_INFO: `/v3/projects/b2f0afde82b84975a92f3ad02fcc3a9b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.609987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f0afde82b84975a92f3ad02fcc3a9b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.609987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:36.675709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a96793480704bfcad707d67f1621f83', 'request_id': 'req-3623af9c-4e8e-4a8b-9950-0c45942b5277'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.681969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a96793480704bfcad707d67f1621f83', 'request_id': 'req-3623af9c-4e8e-4a8b-9950-0c45942b5277'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.687730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a96793480704bfcad707d67f1621f83', 'request_id': 'req-3623af9c-4e8e-4a8b-9950-0c45942b5277'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.733966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f0afde82b84975a92f3ad02fcc3a9b', 'request_id': 'req-f97274dc-4eee-4744-949d-a599a9c9b375'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.739414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f0afde82b84975a92f3ad02fcc3a9b', 'request_id': 'req-f97274dc-4eee-4744-949d-a599a9c9b375'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.807269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] The token cache is being invalidate because project 1a96793480704bfcad707d67f1621f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:36.811757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.811757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.811757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 928/1865] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:36 2022] DELETE /identity/v3/projects/1a96793480704bfcad707d67f1621f83 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:36.813594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:36.814892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.853755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f0afde82b84975a92f3ad02fcc3a9b', 'request_id': 'req-f97274dc-4eee-4744-949d-a599a9c9b375'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.878735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] The token cache is being invalidate because project b2f0afde82b84975a92f3ad02fcc3a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:36.879426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.879941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f97274dc-4eee-4744-949d-a599a9c9b375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:36.884968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 938/1866] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:36 2022] DELETE /identity/v3/projects/b2f0afde82b84975a92f3ad02fcc3a9b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:36.886491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623af9c-4e8e-4a8b-9950-0c45942b5277 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:36.886905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10ee3-dfd7-488b-9435-19103318d375 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.892157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10ee3-dfd7-488b-9435-19103318d375 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.892157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10ee3-dfd7-488b-9435-19103318d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.921857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-96d10ee3-dfd7-488b-9435-19103318d375 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:36.925273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96d10ee3-dfd7-488b-9435-19103318d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:36.955986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:36.957308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:36.957784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:36.958302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] PATH_INFO: `/v3/users/39c50e05e2b34969b899e39b83241c2f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:36.960272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c50e05e2b34969b899e39b83241c2f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:36.962882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.009333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 939/1867] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:37.017390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216ce25-a779-4736-a50f-36a589435210 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.022108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216ce25-a779-4736-a50f-36a589435210 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.022524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216ce25-a779-4736-a50f-36a589435210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.060705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d216ce25-a779-4736-a50f-36a589435210 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:37.062159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d216ce25-a779-4736-a50f-36a589435210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:37.073323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 940/1868] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:37.079658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216ce25-a779-4736-a50f-36a589435210 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.088722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216ce25-a779-4736-a50f-36a589435210 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.094370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.095014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.095387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.095670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.096366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:37.096754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.098234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.110109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 941/1869] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:11:37.114385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.124378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1232a0f-34b4-4b6b-81b4-a1445dc3daec admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.134002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.136994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.136994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.136994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.136994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.139816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.223924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c50e05e2b34969b899e39b83241c2f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:37.224613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c50e05e2b34969b899e39b83241c2f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:37.232010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c50e05e2b34969b899e39b83241c2f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:37.244023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c50e05e2b34969b899e39b83241c2f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:37.272434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 942/1870] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:37 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:37.276600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.297708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:37.348479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c50e05e2b34969b899e39b83241c2f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:37.355776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba810847-be55-4b52-bd7f-88f6a1996ab0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.360753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 929/1871] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:36 2022] DELETE /identity/v3/users/39c50e05e2b34969b899e39b83241c2f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:37.424845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.425630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.425975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.426673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.427445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.429990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.544632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 943/1872] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:37 2022] POST /identity/v3/users => generated 281 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:37.547573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.549217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:37.563872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8de7-dba7-4be5-9e45-0428c20f120c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.569569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.570289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.570569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.570877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.571568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.573215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.586766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 930/1873] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:37.592378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.610881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50085944-530e-4025-a1c3-001f637f81e5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.618422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.620234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.621137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.621137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.622330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.623516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029752a5-8a6a-4441-8ca9-2b0b8070e2ac admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.637816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 944/1874] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:37.642552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.655175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04b824-c7e4-47e9-a9ca-22fbd1888992 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.661107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:37.663544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.664454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.664815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.665194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] PATH_INFO: `/v3/projects/5ca3755a303f478b931b31180ea1b5fe/users/6bad126099174d4ea2fe10f07f661949/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.683678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca3755a303f478b931b31180ea1b5fe, user_id=6bad126099174d4ea2fe10f07f661949, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.686982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.788851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 931/1875] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:37 2022] PUT /identity/v3/projects/5ca3755a303f478b931b31180ea1b5fe/users/6bad126099174d4ea2fe10f07f661949/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:37.799315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.799600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.799877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.819090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.820858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:37.841473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] MFA Rules not processed for user `6bad126099174d4ea2fe10f07f661949`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:37.844474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:37.908013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b642c-df6c-47b3-8a05-73d497e297c4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:37.913288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:37.913943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:37.914344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:37.914489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] PATH_INFO: `/v3/projects/81451cb49347473e84c59baaa664c49c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:37.915965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81451cb49347473e84c59baaa664c49c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:37.917101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 945/1876] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:37.918871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:37.962951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:37.964522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.023691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2e3a-65e2-4bfc-ac42-f59dd3c2e03f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.042978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81451cb49347473e84c59baaa664c49c', 'request_id': 'req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.050478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81451cb49347473e84c59baaa664c49c', 'request_id': 'req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.057324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81451cb49347473e84c59baaa664c49c', 'request_id': 'req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.082120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.082901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.083251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.083654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.143629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] The token cache is being invalidate because project 81451cb49347473e84c59baaa664c49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:38.144073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.145133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4eb7ad60-050d-42aa-9b78-1e2a79e70de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.151281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 932/1877] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:37 2022] DELETE /identity/v3/projects/81451cb49347473e84c59baaa664c49c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:38.153438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0ed1-53cc-4ea8-92de-489f3f4354a4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.153929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0ed1-53cc-4ea8-92de-489f3f4354a4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.154436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0ed1-53cc-4ea8-92de-489f3f4354a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.176347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.177969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.179232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1c2a0ed1-53cc-4ea8-92de-489f3f4354a4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:38.180540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1c2a0ed1-53cc-4ea8-92de-489f3f4354a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.189391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 946/1878] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:38.209880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.288008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 933/1879] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:38.295998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.296287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.296560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.333174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:38.334397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.343121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a42cdd-d36b-4eaf-ac2b-9c9fbe6aa981 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.345277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.346242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.346637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.347038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] PATH_INFO: `/v3/users/6bad126099174d4ea2fe10f07f661949` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.348797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bad126099174d4ea2fe10f07f661949)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.349430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 934/1880] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:38.350321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.351197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.361138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ce1a-e285-4fb6-af22-6163036ed2c3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.366645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.372132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.385715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 935/1881] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:38.390944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.411426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44640a-9800-4da3-8f50-1daa8843b07a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.411426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.411426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.411426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.411983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.411983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.411983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.533351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 936/1882] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:38 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:38.534537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.585159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bad126099174d4ea2fe10f07f661949'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.586339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bad126099174d4ea2fe10f07f661949'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.587085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bad126099174d4ea2fe10f07f661949'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.604078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bad126099174d4ea2fe10f07f661949'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.615541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597c15-bda2-476a-a3d9-97a54ba77602 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.622267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.623078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.623363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.623639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.625775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.626344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.703611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c55a6dba-e9b8-47b4-85f1-a47d9a4f0a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bad126099174d4ea2fe10f07f661949'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:38.715927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 937/1883] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:38 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:38.720377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.722471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.724874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 947/1884] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:38 2022] DELETE /identity/v3/users/6bad126099174d4ea2fe10f07f661949 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:38.732443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.733332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.733696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.735513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010f70-3a06-4d74-9a5a-78dd3e66d8e1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.742641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:38.764147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:38.765367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.808572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.810343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.810960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.811601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.812383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.814004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.828510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 938/1885] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:38.832248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.842018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 948/1886] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:38.844627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a984a8b-3325-475d-be80-4fd4cf8207b2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.852718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.854883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:38.860598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.861396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.862061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.862779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.863218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.864919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.865374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:38.878536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 939/1887] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:38.882461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:38.893806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742113f-b0aa-4799-b692-757340f122a3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.899438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.900375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.900714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.901141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] PATH_INFO: `/v3/projects/cc716707ca2345b39a35b22cfd458ba9/users/b57a3526cbc142d89225d1fc16460cef/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.919467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc716707ca2345b39a35b22cfd458ba9, user_id=b57a3526cbc142d89225d1fc16460cef, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.923236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.927019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef440f7-c706-4bea-97a2-2fd56c0b515e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:38.930789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:38.931477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:38.932607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:38.932607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:38.942508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:38.944220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac7d2-ab3d-4923-b26f-724ab4eb3ff6 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:38.954654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 949/1888] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:39.037406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 940/1889] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:38 2022] PUT /identity/v3/projects/cc716707ca2345b39a35b22cfd458ba9/users/b57a3526cbc142d89225d1fc16460cef/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:39.051454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.051759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.052033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.083194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] MFA Rules not processed for user `b57a3526cbc142d89225d1fc16460cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:39.084639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:39.165166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 950/1890] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:39.171517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.259998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c00bf-56d9-401f-8d62-5796513a1974 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.265712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.266612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.266924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.267198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.268104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.270204 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.390057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 941/1891] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:39.391597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.403656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d3e1-6290-4567-9727-686e6c7c5b6d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.420889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.424025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:39.480478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.482425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.482914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.483186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.483869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.486398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.534963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2c162-ea1d-4c71-b0b8-4a155b5d4009 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.534963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.534963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.534963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.535532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] PATH_INFO: `/v3/projects/5ca3755a303f478b931b31180ea1b5fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.535532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca3755a303f478b931b31180ea1b5fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.537268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.649360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 951/1892] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:39.654080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.658401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:39.670295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8692d81-c338-411e-9a88-984cf117e50c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.686363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca3755a303f478b931b31180ea1b5fe', 'request_id': 'req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:39.705765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca3755a303f478b931b31180ea1b5fe', 'request_id': 'req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:39.713852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca3755a303f478b931b31180ea1b5fe', 'request_id': 'req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:39.762613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.766900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.766900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.766900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.766900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.766900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.782549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 952/1893] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:39.784262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.796753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdf564-63cc-4026-96f9-7009b6701cce admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.801824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.802521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.802837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.803179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] PATH_INFO: `/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad/users/91f7c07294e04e4ab2776911308e1087/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.826119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] The token cache is being invalidate because project 5ca3755a303f478b931b31180ea1b5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:39.826341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:39.827280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2e1dcfa-a6e9-4bd7-ae03-757f48ac7123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:39.829422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 942/1894] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:39 2022] DELETE /identity/v3/projects/5ca3755a303f478b931b31180ea1b5fe => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:39.845500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22d31a5e25d4cfa8b07b4ce1778cbad, user_id=91f7c07294e04e4ab2776911308e1087, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.845500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.849305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a46-326d-42c1-b87d-69e1c260c33f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.849596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a46-326d-42c1-b87d-69e1c260c33f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.849874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796a46-326d-42c1-b87d-69e1c260c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.872335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ae796a46-326d-42c1-b87d-69e1c260c33f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:39.873681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ae796a46-326d-42c1-b87d-69e1c260c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:39.882093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 943/1895] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:39.891250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.891640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.892127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.913166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:39.913927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:39.922649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 944/1896] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:39.926877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.936616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f9cc-fc5f-4dac-bebd-680878d6e0c7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:39.941999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:39.941999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:39.942212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:39.942323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:39.943055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:39.943552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:39.945175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:39.968908 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 953/1897] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:39 2022] PUT /identity/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad/users/91f7c07294e04e4ab2776911308e1087/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:39.972382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 945/1898] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:11:39.973037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.973914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:39.975720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:39.985894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5251-2842-44ea-a6aa-b89c679977a3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.054620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ccb4d-acb9-41b4-b1b6-1c571cd6b4c8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.060032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.060665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.060943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.061222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.061897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.063871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.066415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.068182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.069124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.069871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.071173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.073087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.090911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 954/1899] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:40.092923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.104380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16730a-6d01-46db-ad85-9c3ed8f86778 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.112682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.113319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.113604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.113884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] PATH_INFO: `/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad/users/91f7c07294e04e4ab2776911308e1087/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.116091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22d31a5e25d4cfa8b07b4ce1778cbad, user_id=91f7c07294e04e4ab2776911308e1087, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.118872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724c13-54a4-4d73-8ea0-1da975953bff admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.131122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 955/1900] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:40 2022] PUT /identity/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad/users/91f7c07294e04e4ab2776911308e1087/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:40.144344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.144633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.144913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.175916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] MFA Rules not processed for user `91f7c07294e04e4ab2776911308e1087`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:40.177209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:40.200419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 946/1901] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:39 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:40.202194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.275222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 956/1902] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:40.283800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:40.288425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.292154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:40.308061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307474c-d7d0-47c3-9e6d-bd060e2b58c5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.314654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.315333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.321898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.321898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.321898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.321898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.358190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d1a9-fc57-49dd-abdf-bc66f0aceb9c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.407796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.408429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.408706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.408978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.433691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 947/1903] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:40 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:40.435672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.446505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd516b-76eb-441d-987c-b0bdfaa958e5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.457009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.457009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.457248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.457483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.458181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.459843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.471548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 948/1904] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:40.475441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.477356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.478843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.486579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5533e-29bc-42cb-a347-e8bdf3d0548f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.489872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 957/1905] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:40.491473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.492123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.492401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.492714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.493430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.495014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.507797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 949/1906] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:40.511946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.524063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1121-afa9-49fa-8af8-44220f5c1631 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.529705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.530386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.530669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.530985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] PATH_INFO: `/v3/projects/3dd1219d3d594729b057d937b7eb30b2/users/e7c68a924b9042859622531d2f2afe4f/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.549344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd1219d3d594729b057d937b7eb30b2, user_id=e7c68a924b9042859622531d2f2afe4f, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.552216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc78595-3746-4d47-98a7-b01c6f60dacf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.617046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.619507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:40.634300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76af82-d283-41c5-aee0-bf87362e0ec0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.649568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 958/1907] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:40 2022] PUT /identity/v3/projects/3dd1219d3d594729b057d937b7eb30b2/users/e7c68a924b9042859622531d2f2afe4f/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:40.652299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.652580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.654498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.686743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] MFA Rules not processed for user `e7c68a924b9042859622531d2f2afe4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:40.687902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:40.723579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.724419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.725055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.725541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.729801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:40.774356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 959/1908] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:40.775534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.814872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.816327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.832271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 950/1909] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:40.850061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41596c-8cf5-4775-9e7c-c257206ed534 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:40.859034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:40.859681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:40.859962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:40.860238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:40.860917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:40.862947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:40.888414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:40.969841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 960/1910] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:40 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:40.971724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:40.985082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8158048-18e6-4486-8266-2901cc6b67b1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.044425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.045166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.045504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.045828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.046501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.048484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.053820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:41.202541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 951/1911] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:40 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:41.206689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.218676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cf25b-0f88-4ae5-a57a-127d5e3b3b4c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.223768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.228210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.228210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.228210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.228210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.228210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.238516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 961/1912] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:41.242912 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.253822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db3e15-f1e1-4aaa-9190-f42057b6081a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.258545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.262855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.262855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.262855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] PATH_INFO: `/v3/projects/66f2ade4054b4da28b777e17ba46933c/users/9bd5bb43becd4b138a9f492244a1fb22/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.275441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f2ade4054b4da28b777e17ba46933c, user_id=9bd5bb43becd4b138a9f492244a1fb22, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.278927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.345421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 952/1913] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:41 2022] PUT /identity/v3/projects/66f2ade4054b4da28b777e17ba46933c/users/9bd5bb43becd4b138a9f492244a1fb22/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:41.349251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.360753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8980-dee3-4851-b23a-3639120c4536 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.430873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.431766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.432212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.433253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.433742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.435634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d1001-f7bf-4fe7-b275-05df0f22e802 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.450042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 962/1914] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:41.454534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.468778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d5785-29d5-46a5-944d-0405448c3dad admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.474525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.475342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.475684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.476031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] PATH_INFO: `/v3/projects/66f2ade4054b4da28b777e17ba46933c/users/9bd5bb43becd4b138a9f492244a1fb22/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.478639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f2ade4054b4da28b777e17ba46933c, user_id=9bd5bb43becd4b138a9f492244a1fb22, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.482083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.493696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 953/1915] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:41 2022] PUT /identity/v3/projects/66f2ade4054b4da28b777e17ba46933c/users/9bd5bb43becd4b138a9f492244a1fb22/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:41.504672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2975cb-32d4-4579-8506-69cc155409a8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.504960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2975cb-32d4-4579-8506-69cc155409a8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.505236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2975cb-32d4-4579-8506-69cc155409a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.542777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bf2975cb-32d4-4579-8506-69cc155409a8 None None] MFA Rules not processed for user `9bd5bb43becd4b138a9f492244a1fb22`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:41.542777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bf2975cb-32d4-4579-8506-69cc155409a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:41.625136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 963/1916] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:41.637977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:41.704623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159be2a9-5caf-4b43-ab00-ce5389ac3c33 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:41.708208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:41.708833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:41.709113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:41.709391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:41.771609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:41.773339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd8003-b762-4473-984f-d448b2eaf2f3 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:41.783118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 954/1917] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:41.966283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:42.562309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:42.931479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:43.351855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:44.348698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:44.489939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:44.490321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:44.490673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:44.492171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 964/1918] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:11:44.509139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:44.510036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:44.510313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:44.532234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:44.533814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:44.605067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 955/1919] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:44.616838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:44.618535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:44.636247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e3351-45c7-4ff0-8eb4-57d5a94c77b3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:44.642535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:44.643442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:44.643807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:44.644125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:44.657877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:44.659558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:44.665461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:44.666984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:44.671268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 965/1920] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:44.767214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d93f-0bf5-4bba-8417-ecae70b581b4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:44.772382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:44.773302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:44.773589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:44.773862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] PATH_INFO: `/v3/users/0255239eb633471da9b946cac26b7f28` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:44.775864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0255239eb633471da9b946cac26b7f28)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:44.778503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:44.995687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.008207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223705-9390-4525-8533-cb05ce8b7162 service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.013745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.014594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.015058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.015622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] PATH_INFO: `/v3/users/e7c68a924b9042859622531d2f2afe4f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.016980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c68a924b9042859622531d2f2afe4f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.018943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:45.019636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0255239eb633471da9b946cac26b7f28'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.020497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0255239eb633471da9b946cac26b7f28'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.031340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0255239eb633471da9b946cac26b7f28'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.046886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0255239eb633471da9b946cac26b7f28'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.068762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:45.111004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bf6bd138-60d6-43c2-a43c-b7b2e84c3562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0255239eb633471da9b946cac26b7f28'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.117642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 956/1921] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:44 2022] DELETE /identity/v3/users/0255239eb633471da9b946cac26b7f28 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:45.186201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c68a924b9042859622531d2f2afe4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.187001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c68a924b9042859622531d2f2afe4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.187834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c68a924b9042859622531d2f2afe4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.200590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c68a924b9042859622531d2f2afe4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.274098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c68a924b9042859622531d2f2afe4f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.287838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 966/1922] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:44 2022] DELETE /identity/v3/users/e7c68a924b9042859622531d2f2afe4f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:45.292357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.292644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.292925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.311927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:45.313126 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.362742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.364276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.373175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 957/1923] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:45.382691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.384770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.444834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:45.448391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb057d8a-bb18-495c-8c88-6250a6e04666 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.453355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.453978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.454267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.454548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.466850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.468321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2df4-8f8e-4bb2-af81-9e4b1a875a6e service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:45.481584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 958/1924] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:45.514225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007770d2-358b-40d6-9b1d-5f0f7ef78b2f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.519309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.519958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.520236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.520705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] PATH_INFO: `/v3/projects/87c14c9f79c64687977a1233d1267e87` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.521958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c14c9f79c64687977a1233d1267e87)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.524306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:45.645953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c14c9f79c64687977a1233d1267e87', 'request_id': 'req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.666391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c14c9f79c64687977a1233d1267e87', 'request_id': 'req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.756692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c14c9f79c64687977a1233d1267e87', 'request_id': 'req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.769794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] The token cache is being invalidate because project 87c14c9f79c64687977a1233d1267e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:45.770090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.770980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b82e3f2e-32e5-4be7-8d6e-a96612c03fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:45.773036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 967/1925] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:45 2022] DELETE /identity/v3/projects/87c14c9f79c64687977a1233d1267e87 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:45.777998 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.778774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.778774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.801121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:45.802349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.863466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 959/1926] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:45.872313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.872635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.872889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.894297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:45.895751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.905074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 968/1927] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:45.917774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.919546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.921706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e46c5-b88c-4748-a503-8ccdebcfd374 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.923227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:45.926931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.927562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.927844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.928121 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.928826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:45.929302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.931371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:45.936885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e68c3-c753-4b89-8878-629045812471 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.942459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.943085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.943440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.952374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] PATH_INFO: `/v3/projects/3dd1219d3d594729b057d937b7eb30b2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.952594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 960/1928] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:45.952674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd1219d3d594729b057d937b7eb30b2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.952674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:45.954390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:45.977440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3746f-07a9-4ef5-92d0-dd99f4288e8e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:45.983834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:45.984699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:45.985776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:45.986258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:45.987151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:45.989590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.070417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd1219d3d594729b057d937b7eb30b2', 'request_id': 'req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.076379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd1219d3d594729b057d937b7eb30b2', 'request_id': 'req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.086841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 961/1929] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:45 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:46.091702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.154661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7406b-b5e2-452d-91d4-aee5bfd0c4dd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.159499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.160365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.160472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.160743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.161399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.163353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.170324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd1219d3d594729b057d937b7eb30b2', 'request_id': 'req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.187826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] The token cache is being invalidate because project 3dd1219d3d594729b057d937b7eb30b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:46.188116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.188788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.190369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 969/1930] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:45 2022] DELETE /identity/v3/projects/3dd1219d3d594729b057d937b7eb30b2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:46.192671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.193942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.257120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da2e6e-dcf6-40c9-a33c-6c1be4625669 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.261664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.262959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.263379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.263647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] PATH_INFO: `/v3/users/b57a3526cbc142d89225d1fc16460cef` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.264857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57a3526cbc142d89225d1fc16460cef)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.266790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.272125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 962/1931] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:46 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:46.272125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.274021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.287345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c66d2d-25fa-4e45-8bbd-e54b470ce2e1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.292129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.295831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.295831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.295831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] PATH_INFO: `/v3/users/9bd5bb43becd4b138a9f492244a1fb22` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.295831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd5bb43becd4b138a9f492244a1fb22)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.296568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.447228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57a3526cbc142d89225d1fc16460cef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.447809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57a3526cbc142d89225d1fc16460cef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.448425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57a3526cbc142d89225d1fc16460cef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.460776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57a3526cbc142d89225d1fc16460cef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.470494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd5bb43becd4b138a9f492244a1fb22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.471176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd5bb43becd4b138a9f492244a1fb22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.477922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd5bb43becd4b138a9f492244a1fb22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.489630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd5bb43becd4b138a9f492244a1fb22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.567792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57a3526cbc142d89225d1fc16460cef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.581587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 970/1932] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:46 2022] DELETE /identity/v3/users/b57a3526cbc142d89225d1fc16460cef => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:46.582409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.583752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.636498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4b1fa45a-2fe6-44a4-8b33-db13455f394c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd5bb43becd4b138a9f492244a1fb22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:46.643963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 963/1933] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:46 2022] DELETE /identity/v3/users/9bd5bb43becd4b138a9f492244a1fb22 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:46.645138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.645425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.645702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.651715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9eb7-9360-49f8-a129-6347ca6b9371 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.667814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:46.669843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.725631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.726385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.726663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.726979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.727666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.729258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.742844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 964/1934] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:46.748940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 971/1935] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:46.751984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.752549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.754252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.755263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:46.770672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c16b-bf65-4f29-8979-c4dc446b1f27 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.776500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.777278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.777706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.778072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.778913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.780583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.791108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 972/1936] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:46.797938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:46.808324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612ee0-f891-41d1-b59e-ea3a886543f3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.817197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.817197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.817197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.817197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] PATH_INFO: `/v3/projects/324a57411dc9420aa216a8fa9297ba3e/users/a1f1d6a924e44810bfc565921ae55f49/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.834239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326b0c-9766-462b-97ce-88085b6ff27d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:46.840703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:46.841696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.842231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.844144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324a57411dc9420aa216a8fa9297ba3e, user_id=a1f1d6a924e44810bfc565921ae55f49, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.847979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.860321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.874742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:46.876353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe2470-33c5-493f-913b-0682219f1912 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:46.893459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 965/1937] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:46.962378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 973/1938] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:46 2022] PUT /identity/v3/projects/324a57411dc9420aa216a8fa9297ba3e/users/a1f1d6a924e44810bfc565921ae55f49/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:46.967483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:46.967901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:46.968201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:46.989166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:46.990378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.078873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 966/1939] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:47.087493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.089720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.161051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976250d-c19d-48d1-9555-513f6c03be35 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.166436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.169576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.169576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.169576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.179355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.181002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.191275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 974/1940] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:47.297612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:47.311230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.312705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.334866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19169db-504b-4362-b253-0f78f1d3b3c9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.341115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.341864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.342148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.342425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] PATH_INFO: `/v3/projects/66f2ade4054b4da28b777e17ba46933c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.343694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f2ade4054b4da28b777e17ba46933c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.345640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.482205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f2ade4054b4da28b777e17ba46933c', 'request_id': 'req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.488597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f2ade4054b4da28b777e17ba46933c', 'request_id': 'req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.494272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f2ade4054b4da28b777e17ba46933c', 'request_id': 'req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.577030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] The token cache is being invalidate because project 66f2ade4054b4da28b777e17ba46933c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:47.577332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.578031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-99b1af9d-b4f7-474a-a4e3-bc5fb93c7188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.579937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 967/1941] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:47 2022] DELETE /identity/v3/projects/66f2ade4054b4da28b777e17ba46933c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:47.583071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.584590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.584996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a081-48f2-45c9-8e72-9d5d95eff772 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.585289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a081-48f2-45c9-8e72-9d5d95eff772 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.586231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a081-48f2-45c9-8e72-9d5d95eff772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.604938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057cec8-fde1-406a-b1c4-1ff7e5dbe2e0 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.611760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-61c4a081-48f2-45c9-8e72-9d5d95eff772 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:47.613356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-61c4a081-48f2-45c9-8e72-9d5d95eff772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.680743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.681418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.681704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.682012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] PATH_INFO: `/v3/projects/cc716707ca2345b39a35b22cfd458ba9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.683196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc716707ca2345b39a35b22cfd458ba9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.686751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 968/1942] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:47.686891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.693362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.693700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.693989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.714508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:47.716360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.724488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 969/1943] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:47.728800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.738816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbe216-de8f-4538-be0e-14049d08d163 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.743670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.751646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.760227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 970/1944] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:11:47.765276 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.777356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e09e-420d-44f5-8869-7be434e597e9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.782609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.783264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.783549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.783827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.784484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.786397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.826003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc716707ca2345b39a35b22cfd458ba9', 'request_id': 'req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.837696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc716707ca2345b39a35b22cfd458ba9', 'request_id': 'req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.876741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 971/1945] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:47 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:47.880897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.925578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc716707ca2345b39a35b22cfd458ba9', 'request_id': 'req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.938094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] The token cache is being invalidate because project cc716707ca2345b39a35b22cfd458ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:47.938385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.939190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:47.941078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 975/1946] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:47 2022] DELETE /identity/v3/projects/cc716707ca2345b39a35b22cfd458ba9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:47.944557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc04e4-59bf-4e71-9374-e188b901362d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:47.945033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:47.946871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:47.950861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:47.951494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:47.951772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:47.952044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:47.952744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:47.954679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:47.983280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:48.014396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8c072-eac9-4ca8-99d4-05d313d1f0b5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.019189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.019840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.020117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.020393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] PATH_INFO: `/v3/users/91f7c07294e04e4ab2776911308e1087` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.021576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f7c07294e04e4ab2776911308e1087)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.023799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.093679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 972/1947] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:47 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:48.097485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.099250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.113397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b498-ba59-4aad-9a03-33385de86233 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.117717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.118504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.118679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.119096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.119785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.121753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.143024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 973/1948] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:48.146921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.158287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0760-c62f-4335-bd6e-00a0647b4485 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.163150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.163761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.164038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.164303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.165175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.166618 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.185288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 974/1949] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:48.189706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.201609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dfa99-3c37-4d16-85d4-afd2099f62d3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.212754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.212983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f7c07294e04e4ab2776911308e1087'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:48.213499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f7c07294e04e4ab2776911308e1087'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:48.214173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f7c07294e04e4ab2776911308e1087'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:48.214990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.216274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.216815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] PATH_INFO: `/v3/projects/95eda4f13503417c8616ba15a2ccde35/users/bc414498aa4848ab858ab65b8ce96b29/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.229183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f7c07294e04e4ab2776911308e1087'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:48.241012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95eda4f13503417c8616ba15a2ccde35, user_id=bc414498aa4848ab858ab65b8ce96b29, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.244079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.285434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cc340a88-decc-4d8a-ad81-9e3ee28b2ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f7c07294e04e4ab2776911308e1087'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:48.298479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 976/1950] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:47 2022] DELETE /identity/v3/users/91f7c07294e04e4ab2776911308e1087 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:48.353313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 975/1951] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:48 2022] PUT /identity/v3/projects/95eda4f13503417c8616ba15a2ccde35/users/bc414498aa4848ab858ab65b8ce96b29/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:48.364128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca795-089b-4e98-8d2e-e6ea3d378627 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.365065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca795-089b-4e98-8d2e-e6ea3d378627 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.365065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acca795-089b-4e98-8d2e-e6ea3d378627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.395590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6acca795-089b-4e98-8d2e-e6ea3d378627 None None] MFA Rules not processed for user `bc414498aa4848ab858ab65b8ce96b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:48.396879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6acca795-089b-4e98-8d2e-e6ea3d378627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.473656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 977/1952] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:48.478142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.480118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.548520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.548805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.549079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.574888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a15866-6ea3-4302-a072-9dd44eecd775 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.580233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.581134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.581567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.581991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.582921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.585044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.586029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] MFA Rules not processed for user `a1f1d6a924e44810bfc565921ae55f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:48.587432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.660293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 978/1953] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:48.665063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.666697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.686651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 976/1954] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:48.690658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.691887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5435bbb-62e1-49cd-984d-7d2df9c402c0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.756298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.756927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.757206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.757483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.758477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.760407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.785809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181145f-4919-4a0c-ba5a-89a902be7ec9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.794951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.795592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.795873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.796145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.796810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.798813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.862167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 979/1955] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:48.863063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.864601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:48.884203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 977/1956] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:48.885182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:48.896708 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15054d67-2bab-4b00-8605-f03fbe4b93fc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.936386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a399c-5c7b-468a-895a-10d9bdd3a739 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:48.941221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.941876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.942157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.942432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] PATH_INFO: `/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.943778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22d31a5e25d4cfa8b07b4ce1778cbad)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.945689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:48.957372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:48.958025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:48.958308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:48.958581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:48.959285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:48.961236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.091967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 978/1957] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:48 2022] POST /identity/v3/users => generated 308 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:49.091967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.099259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048460a-3bda-47ca-bc84-52c8c7276e93 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.102218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22d31a5e25d4cfa8b07b4ce1778cbad', 'request_id': 'req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:49.108156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22d31a5e25d4cfa8b07b4ce1778cbad', 'request_id': 'req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:49.157110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.157648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.157924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.158196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.158932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.160595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.170926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 979/1958] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:49.171715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.182624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e3ba-04bf-4964-9b50-ec07dca38846 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.187603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.188281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.188564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.188984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.189655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.190494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22d31a5e25d4cfa8b07b4ce1778cbad', 'request_id': 'req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:49.191235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.202325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 980/1959] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:49.203152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.203455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] The token cache is being invalidate because project d22d31a5e25d4cfa8b07b4ce1778cbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:49.203844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:49.204525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:49.206422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 980/1960] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:48 2022] DELETE /identity/v3/projects/d22d31a5e25d4cfa8b07b4ce1778cbad => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:49.207189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.208541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:49.216741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fdd46-ec44-4266-9581-7ddea2fa8e1b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.222040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.222265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e48d47-5b7e-4b8a-9dbc-f388a796ad38 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.222663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.222978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.223252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.223938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.225543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563383f-651d-4d43-a8dd-18a3ca525faa admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.227243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.227910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.230126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.230126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] PATH_INFO: `/v3/projects/10791ee106734fbfadc82132c3436fee/users/e943f9502528481c997585c5b413a09e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.236263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 981/1961] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:49.237654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.237943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.238217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.244396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10791ee106734fbfadc82132c3436fee, user_id=e943f9502528481c997585c5b413a09e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.247212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b8243-5372-4165-ad0c-2fb9678e9014 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.251102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:49.257400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:49.258809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:49.267269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 982/1962] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:49.267937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.269167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:49.281934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3e744-ae25-4119-9687-00278e9f0bd3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.286612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.287311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.287589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.287863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] PATH_INFO: `/v3/projects/cb8b1542c0d94ba69efff4f5a4200331/users/4c99673ff89a4ad38af0bf84a311f4a2/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.302587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8b1542c0d94ba69efff4f5a4200331, user_id=4c99673ff89a4ad38af0bf84a311f4a2, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.305288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.339794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 981/1963] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:49 2022] PUT /identity/v3/projects/10791ee106734fbfadc82132c3436fee/users/e943f9502528481c997585c5b413a09e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:49.341453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.341900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.342305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.361400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:49.362870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:49.421347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 982/1964] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:49.422199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.431386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e654-7eaf-47ec-b363-029b7d7babc6 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.436839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.437444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.437722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.437998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.438733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.440331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.451072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 983/1965] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:49.461096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 983/1966] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:49 2022] PUT /identity/v3/projects/cb8b1542c0d94ba69efff4f5a4200331/users/4c99673ff89a4ad38af0bf84a311f4a2/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:49.461274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.461781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbbe53-3b03-477d-99fe-66e1b6886a69 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.462903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.529205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:49.531245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.531876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.532179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.532457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.533160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:49.533472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.535211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99ec9-2187-4ffe-9943-776175054bd3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.548008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 984/1967] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:49.549267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.549566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.549836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.579255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] MFA Rules not processed for user `4c99673ff89a4ad38af0bf84a311f4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:49.580490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:49.589596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d812d8f-a6ae-4ec7-a7af-4f590a07b8cc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.595345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.596601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.597050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.597709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] PATH_INFO: `/v3/projects/10791ee106734fbfadc82132c3436fee/users/e943f9502528481c997585c5b413a09e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.600008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10791ee106734fbfadc82132c3436fee, user_id=e943f9502528481c997585c5b413a09e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.603053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.615834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 984/1968] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:49 2022] PUT /identity/v3/projects/10791ee106734fbfadc82132c3436fee/users/e943f9502528481c997585c5b413a09e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:49.616934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.667250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 985/1969] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:49.672721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.685390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33e884-9067-4188-b57b-6b39efda7954 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.715036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f8c45-1b8c-48a5-8387-63cbb6e8d6e2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.719985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.720599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.720876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.721147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.721812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.727064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.751848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.752468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.752746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.753041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.753778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.755786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.813311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 985/1970] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:49.817543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.868050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 986/1971] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:49.869159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:49.880964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a157-3ce4-4bc0-8722-ca1d233e640f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.938021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533381c-b58b-4554-8666-5e2e11cd773e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:49.943839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.944589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.944882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.945294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.946014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.948050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:49.949360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:49.951132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:49.951413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:49.951687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:49.952355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:49.954338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.139512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 987/1972] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:50.139698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 986/1973] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:49 2022] POST /identity/v3/users => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:50.139798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.146347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.150045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f860e-b6c1-47a7-9f35-2f8c2a3c05dc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.155050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.155687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.155959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.156370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.157075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.158698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.159337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48dde2-ff00-4809-a1ed-a4ce58784aa6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.165555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.166445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.166928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.171281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.171281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.171454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 988/1974] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:50.171563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.174507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.181591 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 987/1975] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:50.186632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.189661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad32055-03ac-4d3f-8314-8d6cb6cb925b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.194357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.195115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.200340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.200340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.200340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.200340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.200727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9573-3820-4178-ba7e-27e0773fbf2f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.205773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.206529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.206979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.207320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] PATH_INFO: `/v3/projects/135599bcd9174819978d1e7baecde900/users/5f39cae7dd4e46f5b226081bbf7a7920/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.214749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 989/1976] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:50.217157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.224809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=135599bcd9174819978d1e7baecde900, user_id=5f39cae7dd4e46f5b226081bbf7a7920, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.227829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.229839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08ee03-41a4-49ce-af6a-7668c0bf393e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.236228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.238277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.238558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.238874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] PATH_INFO: `/v3/projects/69f8bacc9d89465f94f01043b84e8fd4/users/5d2f4d4975bb4c87806aeb31b3aa00bc/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.258664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f8bacc9d89465f94f01043b84e8fd4, user_id=5d2f4d4975bb4c87806aeb31b3aa00bc, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.261612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b3a0e-fba2-48bb-9b6a-97f23a342ee6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.339543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 988/1977] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:50 2022] PUT /identity/v3/projects/135599bcd9174819978d1e7baecde900/users/5f39cae7dd4e46f5b226081bbf7a7920/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:50.344441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.348108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:50.352992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 990/1978] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:50 2022] PUT /identity/v3/projects/69f8bacc9d89465f94f01043b84e8fd4/users/5d2f4d4975bb4c87806aeb31b3aa00bc/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:50.366607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.367096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.367473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.404921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] MFA Rules not processed for user `5d2f4d4975bb4c87806aeb31b3aa00bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:50.406283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:50.427844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dcc5b-419b-45c1-8d88-770876d4bdfd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.493232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.494012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 991/1979] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:50.494141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.494141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.494606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.495468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.498061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.499806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.510639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 989/1980] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:50.515309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc216-ed94-49ba-9a62-52d7e5a9cd9e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.516562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.520536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.521289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.521642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.521990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.523023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.525029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.527560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50a8b-7783-4e16-a4d3-c20e014955c8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.534089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.535542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.535824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.538461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] PATH_INFO: `/v3/projects/135599bcd9174819978d1e7baecde900/users/5f39cae7dd4e46f5b226081bbf7a7920/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.539262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135599bcd9174819978d1e7baecde900, user_id=5f39cae7dd4e46f5b226081bbf7a7920, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.542212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc1d4-3202-4804-aa6b-53198ff2b354 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.557505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 990/1981] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:50 2022] PUT /identity/v3/projects/135599bcd9174819978d1e7baecde900/users/5f39cae7dd4e46f5b226081bbf7a7920/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:50.568104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.568391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.568669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.598033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] MFA Rules not processed for user `5f39cae7dd4e46f5b226081bbf7a7920`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:50.599394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:50.681371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 992/1982] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:50 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:50.688744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 991/1983] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:50.692396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.702987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.702987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:50.768588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453b4da-7daf-4ce0-a970-fcd3f6dd73f0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.772405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d629-9347-4ef7-9a4f-10896e633546 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.773882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.774256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.774538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.774848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.775515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.777534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.826172 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.826894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.827094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.827368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.830596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:50.870533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 993/1984] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:50 2022] POST /identity/v3/users => generated 307 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:50.874601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.892361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865618c-d100-4ae1-9c6a-668dd2c3f5e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.897161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.898132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.898493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.898809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.900130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.901122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.904185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.905893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdd467-e82b-4dbb-8775-bc0a3c5b81a0 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:50.913615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 994/1985] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:50.915942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 992/1986] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:50.917562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:50.929824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc71fc-8adf-49cc-9b24-5f2901be155e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:50.935722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:50.936408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:50.936805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:50.937113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] PATH_INFO: `/v3/projects/d39b39bf88c142549ff6f476cd5bd906/users/bdd03c4edfbf4489a24999d93985bbe6/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:50.953813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39b39bf88c142549ff6f476cd5bd906, user_id=bdd03c4edfbf4489a24999d93985bbe6, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:50.956484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:51.022226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.023100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.023100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.037367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 995/1987] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:50 2022] PUT /identity/v3/projects/d39b39bf88c142549ff6f476cd5bd906/users/bdd03c4edfbf4489a24999d93985bbe6/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:51.041128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:51.079926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] MFA Rules not processed for user `e943f9502528481c997585c5b413a09e`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:51.081192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:51.138419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625e6c9-0167-412b-9066-4885f00a7610 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:51.143114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:51.143751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.144016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.144301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.144995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:51.146590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e89fef-4359-480b-9aec-c9c0e4ad5ce4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:51.156088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 993/1988] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:51.163554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 996/1989] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:51.164817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:51.190427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97177c-de1a-4f32-a73b-a8878e041026 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:51.198415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:51.199232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.199773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.200219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] PATH_INFO: `/v3/projects/d39b39bf88c142549ff6f476cd5bd906/users/bdd03c4edfbf4489a24999d93985bbe6/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.202738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39b39bf88c142549ff6f476cd5bd906, user_id=bdd03c4edfbf4489a24999d93985bbe6, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:51.214212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:51.216550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:51.228506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 994/1990] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:51 2022] PUT /identity/v3/projects/d39b39bf88c142549ff6f476cd5bd906/users/bdd03c4edfbf4489a24999d93985bbe6/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:51.239526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.240540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.240830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.273943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] MFA Rules not processed for user `bdd03c4edfbf4489a24999d93985bbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:51.275401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:51.333135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:51.359433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 997/1991] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:51.370689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:51.373274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:51.439324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21244a44-45b2-450d-9191-cde56b6a3e0f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:51.442657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:51.443420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.443702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.443974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.453756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:51.455220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000ada0-2e05-4230-8d90-50f6729d08cf service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:51.465404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 995/1992] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:51.690083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:51.701668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987be8-a3a3-4092-be56-e0882cd5893c None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:51.706063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:51.706815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.707317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.707793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:51.771287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:51.772998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca785504-fe10-43de-b583-a12b8014f224 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:51.782681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 998/1993] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:51.998460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643d883-52a8-427b-be67-631497c0d086 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:51.998961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643d883-52a8-427b-be67-631497c0d086 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:51.999335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643d883-52a8-427b-be67-631497c0d086 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:52.001242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 996/1994] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:11:52.015742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:52.016027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:52.016303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:52.038844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] MFA Rules not processed for user `f523bf78506741138174ea01898f58df`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:52.040112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:52.079611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:52.105849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 999/1995] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:52.116848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643d883-52a8-427b-be67-631497c0d086 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:52.118532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b643d883-52a8-427b-be67-631497c0d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:52.135818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643d883-52a8-427b-be67-631497c0d086 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:52.142015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:52.142695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:52.142999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:52.148088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:52.153607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:52.155305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:52.175946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 997/1996] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:52.237309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:52.950790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:52.959785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ed9e-f987-496b-bdb6-336730746290 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:52.963432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:52.964305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:52.964490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:52.964771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:53.015440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:53.028128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:53.034311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:53.039667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1000/1997] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:11:53.089467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a767-5e20-453f-9985-2443cf98ee48 service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:53.097023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:53.097781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:53.098137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:53.098496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] PATH_INFO: `/v3/users/a1f1d6a924e44810bfc565921ae55f49` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:53.099828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f1d6a924e44810bfc565921ae55f49)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:53.102830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:53.309369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f1d6a924e44810bfc565921ae55f49'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:53.310059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f1d6a924e44810bfc565921ae55f49'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:53.317262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f1d6a924e44810bfc565921ae55f49'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:53.330584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f1d6a924e44810bfc565921ae55f49'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:53.407519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f1d6a924e44810bfc565921ae55f49'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:53.414386 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 998/1998] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:53 2022] DELETE /identity/v3/users/a1f1d6a924e44810bfc565921ae55f49 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:53.431512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:53.745191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:53.757880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4cff6-30e5-442e-9ba8-e3fe2b40fe78 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:53.844493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:53.845249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:53.845512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:53.845689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] PATH_INFO: `/v3/projects/324a57411dc9420aa216a8fa9297ba3e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:53.847181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324a57411dc9420aa216a8fa9297ba3e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:53.849108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:53.948624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:53.998419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324a57411dc9420aa216a8fa9297ba3e', 'request_id': 'req-40ee3c24-1d70-4f11-9ffa-f517383f7344'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.004273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324a57411dc9420aa216a8fa9297ba3e', 'request_id': 'req-40ee3c24-1d70-4f11-9ffa-f517383f7344'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.096476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324a57411dc9420aa216a8fa9297ba3e', 'request_id': 'req-40ee3c24-1d70-4f11-9ffa-f517383f7344'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.108834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] The token cache is being invalidate because project 324a57411dc9420aa216a8fa9297ba3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:54.109125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.109763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.111348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1001/1999] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:53 2022] DELETE /identity/v3/projects/324a57411dc9420aa216a8fa9297ba3e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:54.115443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:54.116876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:54.130301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65916c-cfb8-4efc-b7f5-a9b328de6688 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:54.187239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:54.187861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:54.188143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:54.188421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] PATH_INFO: `/v3/users/e943f9502528481c997585c5b413a09e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:54.189669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e943f9502528481c997585c5b413a09e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:54.191710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:54.397273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e943f9502528481c997585c5b413a09e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.398351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e943f9502528481c997585c5b413a09e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.405906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e943f9502528481c997585c5b413a09e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.417655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e943f9502528481c997585c5b413a09e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.504588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e943f9502528481c997585c5b413a09e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.518241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 999/2000] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:54 2022] DELETE /identity/v3/users/e943f9502528481c997585c5b413a09e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:54.589869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:54.591899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:54.656573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3c24-1d70-4f11-9ffa-f517383f7344 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:54.713444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:54.714017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:54.714294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:54.714567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:54.717631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:54.749964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:54.751496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:54.804195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:54.805790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2c598-7ced-4316-ad79-778710b7b2b1 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:54.816783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1002/2001] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:54.826236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a636-4965-46aa-9b5b-7a24b5d2b7c0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:54.831523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:54.832317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:54.833337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:54.833801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] PATH_INFO: `/v3/projects/10791ee106734fbfadc82132c3436fee` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:54.835048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10791ee106734fbfadc82132c3436fee)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:54.837112 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:54.974798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10791ee106734fbfadc82132c3436fee', 'request_id': 'req-cd406451-cb29-4bcb-b844-7f0ea4389e45'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.981416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10791ee106734fbfadc82132c3436fee', 'request_id': 'req-cd406451-cb29-4bcb-b844-7f0ea4389e45'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:54.987013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10791ee106734fbfadc82132c3436fee', 'request_id': 'req-cd406451-cb29-4bcb-b844-7f0ea4389e45'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:55.113133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] The token cache is being invalidate because project 10791ee106734fbfadc82132c3436fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:55.113427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:55.114088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cd406451-cb29-4bcb-b844-7f0ea4389e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:55.115866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1000/2002] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:54 2022] DELETE /identity/v3/projects/10791ee106734fbfadc82132c3436fee => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:55.122232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.122882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.122996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.143591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:55.144788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:55.162406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:55.203967 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1003/2003] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:55.211842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.212133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.212414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.217102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:55.235079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:55.236219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:55.244037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1001/2004] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:55.250004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.259624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc41269-1aad-4097-ae5c-b9956751f75f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.264694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.265310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.265596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.265878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.266578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:11:55.266923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.268539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.281029 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1004/2005] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:11:55.285372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.295391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d90239-0f03-4e3d-aac7-0a20d316d4b4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.300129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.300737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.301738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.301738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.302118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.304160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.435070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1002/2006] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:55.439173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.450843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1dc2-1375-4ae7-9c22-69334863ec70 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.514342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.515121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.515472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.515818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.519307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.521325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.623919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1005/2007] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:55.628019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.638416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae885-c13c-44d6-a02f-7091f4e04360 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.643042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.643655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.643940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.644217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.644943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.646599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.657231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1003/2008] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:55.661369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.672301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117eebd-dab5-4850-9af5-09f00422a8dd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.677355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.677979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.678256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.678529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.679311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.681094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28d42-9138-4183-9f9a-0352090044aa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.693274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1006/2009] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:55.702363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.712868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10696f-3361-480a-bcf1-0466f8a24fd0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:55.718407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:55.719100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.719419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.719693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] PATH_INFO: `/v3/projects/c7d1719b0a7e40ce9ebf47d3d7343f94/users/d8720d9820f543369a8dce480928febb/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.735706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d1719b0a7e40ce9ebf47d3d7343f94, user_id=d8720d9820f543369a8dce480928febb, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:55.738395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:55.869259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1004/2010] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:55 2022] PUT /identity/v3/projects/c7d1719b0a7e40ce9ebf47d3d7343f94/users/d8720d9820f543369a8dce480928febb/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:55.880586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155bd1f-a23c-488a-9425-ef8fa47a2c70 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.880897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155bd1f-a23c-488a-9425-ef8fa47a2c70 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.881174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155bd1f-a23c-488a-9425-ef8fa47a2c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:55.909448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9155bd1f-a23c-488a-9425-ef8fa47a2c70 None None] MFA Rules not processed for user `d8720d9820f543369a8dce480928febb`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:55.910653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9155bd1f-a23c-488a-9425-ef8fa47a2c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:55.981134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1007/2011] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:55.991422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:55.993957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:55.994240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:55.994516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.015148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] MFA Rules not processed for user `b94ebcf38d1c4183bfc515a28152dbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:56.016392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:56.055780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661e92-816a-4449-a38c-1efd2c4e199a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.061337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.061964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.062245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.062519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.063213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.065756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.071987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1008/2012] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:56.160214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1005/2013] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:11:55 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:11:56.165090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.190685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba00ab-72de-48dd-a28b-535af8884628 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.256463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.257167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.257494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.257825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.258809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.260897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.265249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:56.356226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1009/2014] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:11:56 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:11:56.360929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.376717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b0f6-902b-441a-9cf1-130c83028613 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.383938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.384964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.385292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.385790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.387098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.391821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.408895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1006/2015] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:11:56.413070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.423765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0fadf-b1d3-44a7-afb6-c38ab08a352d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.428925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.429596 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.429880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.430155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] PATH_INFO: `/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30/users/c7e0a1cab9c9454481d43df065e15b7f/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.445576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d2a4f07ad443f38f7265e6e1c91f30, user_id=c7e0a1cab9c9454481d43df065e15b7f, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.448518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.518466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1010/2016] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:56 2022] PUT /identity/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30/users/c7e0a1cab9c9454481d43df065e15b7f/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:11:56.522635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.534770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1569-ca8a-4f0c-b984-fa18814ac209 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.595404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.596022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.596303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.596573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.597258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.598921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb3ada-efb0-4d22-8bde-177ee779c32f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.613078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1007/2017] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:11:56.614447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.625288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd535a-cd9b-4f69-bf99-3f21c0043276 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.630078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.631621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.631621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.631621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] PATH_INFO: `/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30/users/c7e0a1cab9c9454481d43df065e15b7f/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.633314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d2a4f07ad443f38f7265e6e1c91f30, user_id=c7e0a1cab9c9454481d43df065e15b7f, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:56.636053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:56.647297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1011/2018] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:11:56 2022] PUT /identity/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30/users/c7e0a1cab9c9454481d43df065e15b7f/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:56.659227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.659603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.659953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.694177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] MFA Rules not processed for user `c7e0a1cab9c9454481d43df065e15b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:56.695684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:56.777623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:56.819706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1008/2019] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:56.831089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:56.832864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:56.936037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1086ed-4cef-4f4a-b073-ad58ab7aa06f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:56.940392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:56.940694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:56.940977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:56.941252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:56.999455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:57.000902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dfb9f-5321-4031-af28-9907d027b6bf service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:57.009696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1012/2020] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:57.205593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:57.207326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:57.278887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c852-406e-42c7-b8f2-62119fad92a3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:57.283503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:57.284151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:57.284433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:57.284709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] PATH_INFO: `/v3/users/5d2f4d4975bb4c87806aeb31b3aa00bc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:57.285865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2f4d4975bb4c87806aeb31b3aa00bc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:57.287830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:57.464303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2f4d4975bb4c87806aeb31b3aa00bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:57.464980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2f4d4975bb4c87806aeb31b3aa00bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:57.472670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2f4d4975bb4c87806aeb31b3aa00bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:57.484630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2f4d4975bb4c87806aeb31b3aa00bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:57.548011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2f4d4975bb4c87806aeb31b3aa00bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:57.554836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1009/2021] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:57 2022] DELETE /identity/v3/users/5d2f4d4975bb4c87806aeb31b3aa00bc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:57.559300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:57.560293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:57.560391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:57.580055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:57.581281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:57.639189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1013/2022] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:11:57.649413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:57.650967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:57.722092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626806e8-1442-4305-afdb-90e9beaff263 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:57.725879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:57.726497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:57.726805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:57.727084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:57.736616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:57.738148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:57.749273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1010/2023] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:11:57.807840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:57.896812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:58.272232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:58.277423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:58.287176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7a0d-ec6c-4a7f-9539-7367ed75afe3 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:58.291913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:58.292584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:58.292864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:58.293138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] PATH_INFO: `/v3/projects/69f8bacc9d89465f94f01043b84e8fd4` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:58.295053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f8bacc9d89465f94f01043b84e8fd4)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:58.297318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:58.414969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f8bacc9d89465f94f01043b84e8fd4', 'request_id': 'req-b25686e1-4e24-4592-8be9-2048d8996244'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.421258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f8bacc9d89465f94f01043b84e8fd4', 'request_id': 'req-b25686e1-4e24-4592-8be9-2048d8996244'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.487920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f8bacc9d89465f94f01043b84e8fd4', 'request_id': 'req-b25686e1-4e24-4592-8be9-2048d8996244'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.499879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] The token cache is being invalidate because project 69f8bacc9d89465f94f01043b84e8fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:58.500163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.500804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.502341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1014/2024] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:58 2022] DELETE /identity/v3/projects/69f8bacc9d89465f94f01043b84e8fd4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:58.506323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:58.516144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54825a79-1867-42c5-905f-935222cfe246 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:58.571648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:58.572279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:58.572562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:58.572834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] PATH_INFO: `/v3/users/bdd03c4edfbf4489a24999d93985bbe6` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:58.574017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd03c4edfbf4489a24999d93985bbe6)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:58.576122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:58.740080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd03c4edfbf4489a24999d93985bbe6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.740759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd03c4edfbf4489a24999d93985bbe6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.748954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd03c4edfbf4489a24999d93985bbe6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.761235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd03c4edfbf4489a24999d93985bbe6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.842604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:58.843409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd03c4edfbf4489a24999d93985bbe6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:58.850406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1011/2025] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:58 2022] DELETE /identity/v3/users/bdd03c4edfbf4489a24999d93985bbe6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:59.396414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:59.446590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:59.448310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:59.462352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25686e1-4e24-4592-8be9-2048d8996244 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:59.532438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:59.533264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:59.533614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:59.534057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] PATH_INFO: `/v3/projects/d39b39bf88c142549ff6f476cd5bd906` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:59.535457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39b39bf88c142549ff6f476cd5bd906)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:59.537556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:59.636804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39b39bf88c142549ff6f476cd5bd906', 'request_id': 'req-708975b6-15bb-4124-a12d-a343ae11676a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:59.643170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39b39bf88c142549ff6f476cd5bd906', 'request_id': 'req-708975b6-15bb-4124-a12d-a343ae11676a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:59.648376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:59.740934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:59.742396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:59.755443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eefb-6499-4482-ab3d-835a04e20954 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:59.756599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39b39bf88c142549ff6f476cd5bd906', 'request_id': 'req-708975b6-15bb-4124-a12d-a343ae11676a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:59.767913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:11:59.773270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] The token cache is being invalidate because project d39b39bf88c142549ff6f476cd5bd906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:11:59.773793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:59.774625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-708975b6-15bb-4124-a12d-a343ae11676a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:11:59.776866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1015/2026] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:11:59 2022] DELETE /identity/v3/projects/d39b39bf88c142549ff6f476cd5bd906 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:11:59.782327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:59.782834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:59.783261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:59.804717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:11:59.817689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:59.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:59.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:59.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:59.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] PATH_INFO: `/v3/users/bc414498aa4848ab858ab65b8ce96b29` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:59.822522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc414498aa4848ab858ab65b8ce96b29)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:11:59.824703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:11:59.871148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1016/2027] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:11:59.872107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:11:59.874113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:11:59.931315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143256d0-993b-4617-8552-64cb4afa0fbf None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:11:59.936148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:11:59.937394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:11:59.937696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:11:59.938028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:11:59.940076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.004925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.006785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797217-dad3-4cea-9b6a-dd8455f918d9 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.017018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1017/2028] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:00.018490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.018816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.019099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.042504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:00.043376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.053543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc414498aa4848ab858ab65b8ce96b29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:00.054856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1018/2029] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:00.055252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc414498aa4848ab858ab65b8ce96b29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:00.057482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.065932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc414498aa4848ab858ab65b8ce96b29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:00.067489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d443-2b42-4fef-b820-47974b5effcd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.073470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.074100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.074403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.074775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.075918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:00.076295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.077834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.093980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc414498aa4848ab858ab65b8ce96b29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:00.094981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1019/2030] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:00.095881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.106028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1993067-ba9e-4f08-beac-dbea17afbff2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.111901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.112593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.112941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.113227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.113907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.115851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.165316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3f4727d2-e2a3-44ed-be36-4a4ac05e50cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc414498aa4848ab858ab65b8ce96b29'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:00.172161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1012/2031] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:11:59 2022] DELETE /identity/v3/users/bc414498aa4848ab858ab65b8ce96b29 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:00.177090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.177459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.177810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.205697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1020/2032] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:00.209568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.210597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:00.211865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.211999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.284671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1013/2033] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:00.295506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.298171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.321621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818a4f-aa98-4753-ad59-6d883993cb45 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.327535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.328169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.328447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.328722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.329400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.331588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.363762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dc31a-3d5a-45e5-9bb7-d610c8360afe None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.368548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.370157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.370157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.370417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.381370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.382855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.393637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1014/2034] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:00.437762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1021/2035] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:00.440000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.451703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3b9b4-79fe-4374-a71a-a409d50cf5c5 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.459096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.459726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.460001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.460274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.461598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.463528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.479380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1015/2036] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:00.481439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.500437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44473864-7ca1-43fa-856a-aaa87beb8cfd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.500707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.501630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.502072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.503026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.504058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.505988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3e98-115d-48b4-89d7-335aa9c95630 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.519433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1022/2037] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:00.524425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.538285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e42d-99c9-4901-ad5c-e1c4da55899f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.544003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.544965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.545290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.545813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] PATH_INFO: `/v3/projects/e28c1b68378d4e6293b97c6df0c5b256/users/100f361c464f472c9c5551798bbdb085/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.566247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28c1b68378d4e6293b97c6df0c5b256, user_id=100f361c464f472c9c5551798bbdb085, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.569086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.675054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1016/2038] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:00 2022] PUT /identity/v3/projects/e28c1b68378d4e6293b97c6df0c5b256/users/100f361c464f472c9c5551798bbdb085/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:00.677906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:00.682726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.683093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.683443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.739300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] MFA Rules not processed for user `100f361c464f472c9c5551798bbdb085`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:00.743783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.791252 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:00.842243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1023/2039] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:00.847307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.912270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5affc78-bdf3-4985-af8a-48375b23abda admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.917023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.917661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.917939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.918239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:00.918930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:00.922072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:00.965705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:00.967595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:00.985374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7ab2d-a772-4689-9cbd-3b1401998117 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:00.995064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:00.998048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:00.998367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:00.998789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] PATH_INFO: `/v3/projects/95eda4f13503417c8616ba15a2ccde35` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.001250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=95eda4f13503417c8616ba15a2ccde35)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.003325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.046164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1017/2040] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:00 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:01.047282 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.108029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8444-da30-41aa-b334-229783cfaac8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.112728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.113340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.113623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.113901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.114564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.116512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.194027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95eda4f13503417c8616ba15a2ccde35', 'request_id': 'req-51394138-90b5-4591-936e-7c1a645950aa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.199554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95eda4f13503417c8616ba15a2ccde35', 'request_id': 'req-51394138-90b5-4591-936e-7c1a645950aa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.211715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1018/2041] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:01 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:01.215595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.225654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591d1f5-ae34-4e49-8689-3c3bda7f85bc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.281168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.281721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.282000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.282275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.282993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.285927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.297654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1019/2042] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:01.302660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.311536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95eda4f13503417c8616ba15a2ccde35', 'request_id': 'req-51394138-90b5-4591-936e-7c1a645950aa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.322293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d091bf8-6a43-4de2-85bd-618a08faa754 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.323561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] The token cache is being invalidate because project 95eda4f13503417c8616ba15a2ccde35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:01.324047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.324899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.327174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1024/2043] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:00 2022] DELETE /identity/v3/projects/95eda4f13503417c8616ba15a2ccde35 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:01.329396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.330087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.330422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.330695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] PATH_INFO: `/v3/projects/cbf78faa73db40b5963a5a6cc24759e2/users/745eb882429b4807a87ab051ec5abfd5/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.331726 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.333296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:01.347302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394138-90b5-4591-936e-7c1a645950aa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.347955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf78faa73db40b5963a5a6cc24759e2, user_id=745eb882429b4807a87ab051ec5abfd5, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.350682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.354031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.355094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.355603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.355854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] PATH_INFO: `/v3/users/4c99673ff89a4ad38af0bf84a311f4a2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.357079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c99673ff89a4ad38af0bf84a311f4a2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.359149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.446187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1020/2044] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:01 2022] PUT /identity/v3/projects/cbf78faa73db40b5963a5a6cc24759e2/users/745eb882429b4807a87ab051ec5abfd5/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:01.451099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.459314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:01.530327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba952-eaac-4ecc-a8df-f5988c609070 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.535062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.535686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.535966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.536266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.536956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.538553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.548413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1021/2045] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:01.552560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.562517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b0a2-f28e-4b41-93dd-7dbcd9dc299b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.567165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.567816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.568096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.568371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] PATH_INFO: `/v3/projects/cbf78faa73db40b5963a5a6cc24759e2/users/745eb882429b4807a87ab051ec5abfd5/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.570296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf78faa73db40b5963a5a6cc24759e2, user_id=745eb882429b4807a87ab051ec5abfd5, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.573090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cfc1-dcae-41b7-95b5-f4cd0f9dfae9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.579728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c99673ff89a4ad38af0bf84a311f4a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.580389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c99673ff89a4ad38af0bf84a311f4a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.581030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c99673ff89a4ad38af0bf84a311f4a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.584643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1022/2046] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:01 2022] PUT /identity/v3/projects/cbf78faa73db40b5963a5a6cc24759e2/users/745eb882429b4807a87ab051ec5abfd5/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:01.593247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c99673ff89a4ad38af0bf84a311f4a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.600904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.601488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.601488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.630154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] MFA Rules not processed for user `745eb882429b4807a87ab051ec5abfd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:01.631438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:01.664180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:01.681921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c99673ff89a4ad38af0bf84a311f4a2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:01.702140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1025/2047] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:01 2022] DELETE /identity/v3/users/4c99673ff89a4ad38af0bf84a311f4a2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:01.711014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1023/2048] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:01.723116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:01.727554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:01.741169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:01.810120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ab462-5ced-449c-9c67-f9a92243d643 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:01.813897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:01.814541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:01.814844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:01.815383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:01.892249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:01.893697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:01.913112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1026/2049] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:02.204259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:02.207124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:02.222952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:02.305490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7c773-adc8-4a1c-9989-07015647d44f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:02.333905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:02.379023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:02.379886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:02.380248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:02.380580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] PATH_INFO: `/v3/projects/cb8b1542c0d94ba69efff4f5a4200331` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:02.381903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8b1542c0d94ba69efff4f5a4200331)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:02.384641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:02.488036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8b1542c0d94ba69efff4f5a4200331', 'request_id': 'req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.496142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8b1542c0d94ba69efff4f5a4200331', 'request_id': 'req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.519267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8b1542c0d94ba69efff4f5a4200331', 'request_id': 'req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.633628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] The token cache is being invalidate because project cb8b1542c0d94ba69efff4f5a4200331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:02.633961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.634612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.636315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1024/2050] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:02 2022] DELETE /identity/v3/projects/cb8b1542c0d94ba69efff4f5a4200331 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:02.640755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:02.651471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01260825-86a5-4c1b-b65b-ab51f8c98853 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:02.710321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:02.711003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:02.711281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:02.711553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] PATH_INFO: `/v3/users/5f39cae7dd4e46f5b226081bbf7a7920` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:02.712708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f39cae7dd4e46f5b226081bbf7a7920)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:02.714901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:02.717494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:02.785138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:02.913720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f39cae7dd4e46f5b226081bbf7a7920'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.914375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f39cae7dd4e46f5b226081bbf7a7920'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.915004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f39cae7dd4e46f5b226081bbf7a7920'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:02.929276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f39cae7dd4e46f5b226081bbf7a7920'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.016621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f39cae7dd4e46f5b226081bbf7a7920'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.032337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1027/2051] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:02 2022] DELETE /identity/v3/users/5f39cae7dd4e46f5b226081bbf7a7920 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:03.156813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:03.284008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:03.287433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.305871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec9b9-7cf6-4a2d-bef2-e24a887ef2f6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:03.359459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:03.381619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:03.382606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:03.383117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:03.384223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] PATH_INFO: `/v3/users/100f361c464f472c9c5551798bbdb085` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:03.386144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100f361c464f472c9c5551798bbdb085)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:03.390748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:03.500620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:03.502169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.518088 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad313-2f4d-4c02-8eda-f41f0d061381 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:03.523723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:03.524477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:03.524874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:03.525198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] PATH_INFO: `/v3/projects/135599bcd9174819978d1e7baecde900` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:03.527324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135599bcd9174819978d1e7baecde900)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:03.530524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:03.681292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100f361c464f472c9c5551798bbdb085'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.681962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100f361c464f472c9c5551798bbdb085'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.690789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135599bcd9174819978d1e7baecde900', 'request_id': 'req-bebd8241-bd48-462d-bc75-0933c191b972'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.692488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135599bcd9174819978d1e7baecde900', 'request_id': 'req-bebd8241-bd48-462d-bc75-0933c191b972'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.701309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100f361c464f472c9c5551798bbdb085'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.714246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100f361c464f472c9c5551798bbdb085'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.784540 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135599bcd9174819978d1e7baecde900', 'request_id': 'req-bebd8241-bd48-462d-bc75-0933c191b972'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.798636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] The token cache is being invalidate because project 135599bcd9174819978d1e7baecde900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:03.799362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.800189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bebd8241-bd48-462d-bc75-0933c191b972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.805038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1028/2052] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:03 2022] DELETE /identity/v3/projects/135599bcd9174819978d1e7baecde900 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:03.806948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6e9c-63d4-4ba1-95f9-f3363d089478 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:03.807258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6e9c-63d4-4ba1-95f9-f3363d089478 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:03.807533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6e9c-63d4-4ba1-95f9-f3363d089478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:03.828720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-28bc6e9c-63d4-4ba1-95f9-f3363d089478 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:03.829934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-28bc6e9c-63d4-4ba1-95f9-f3363d089478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.874446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7beae219-968c-4481-9068-63b13bbf89d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100f361c464f472c9c5551798bbdb085'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:03.881575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1025/2053] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:03 2022] DELETE /identity/v3/users/100f361c464f472c9c5551798bbdb085 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:03.885746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:03.886064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:03.886346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:03.888951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1029/2054] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:03.896425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:03.896717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:03.896999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:03.909122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:03.910322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.917051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:03.918245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.972402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1026/2055] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:03.982256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1030/2056] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:03.982687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:03.984082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:03.986546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:03.996072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03d55-c75c-4b3d-b060-8fd8845b56c1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.003010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.003619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.003893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.004164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.004892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:04.007395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.007395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.021115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1031/2057] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:04.025825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.038045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb30eb-32f8-49ec-960d-5843fd223d6f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.043092 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.043784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.044165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.044518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.045238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.047256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.051928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af74a8-b82a-4e23-9ccc-1de0930ee18a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.056032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.056808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.057094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.057367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.072390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.077295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.082393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:04.087443 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1027/2058] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:04.162497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1032/2059] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:04 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:04.172681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.183515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:04.186653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3335b-d47c-4a51-863a-bc1f6f86bfc9 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.243870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.244481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.244762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.245038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.245726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.248289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.330936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1028/2060] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:04 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:04.331624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.342319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b617a-710b-4dde-803b-83a21e4058aa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.351737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.352494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.352839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.353191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.354339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.355920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.372747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1033/2061] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:04.374496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.390066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c1d-dd33-4472-beb2-4686b84c46ef admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.398587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.399581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.400206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.400736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.401605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.403761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.404605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.406238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.422230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d9f8-e9b5-4ea3-b46b-d2f5595760e8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.422559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1029/2062] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:04.423510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.427984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.429129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.429469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.438519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] PATH_INFO: `/v3/users/d8720d9820f543369a8dce480928febb` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.438519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8720d9820f543369a8dce480928febb)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.438519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.438817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ea142-43bd-4098-8c6a-cc2e8482db32 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.439274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.440008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.441149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.441149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] PATH_INFO: `/v3/projects/798c7c16989541ef85a607b1092d2e31/users/cd85cd2a8250456699fdc7a5abfc7e62/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.456900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] RBAC: Authorizing `identity:create_grant(project_id=798c7c16989541ef85a607b1092d2e31, user_id=cd85cd2a8250456699fdc7a5abfc7e62, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.459807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.571235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1030/2063] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:04 2022] PUT /identity/v3/projects/798c7c16989541ef85a607b1092d2e31/users/cd85cd2a8250456699fdc7a5abfc7e62/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:04.601925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.603777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.679595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316bf9-dd71-4d29-9c35-40815bbd212a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.685844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:04.686500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.686812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.687091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] PATH_INFO: `/v3/projects/e28c1b68378d4e6293b97c6df0c5b256` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.688344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28c1b68378d4e6293b97c6df0c5b256)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:04.690267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:04.695351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8720d9820f543369a8dce480928febb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.696039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8720d9820f543369a8dce480928febb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.696832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8720d9820f543369a8dce480928febb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.712622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8720d9820f543369a8dce480928febb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.753768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:04.776182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9e01cb3d-c388-4d94-bd35-3833d74ed81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8720d9820f543369a8dce480928febb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.789195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1034/2064] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:04 2022] DELETE /identity/v3/users/d8720d9820f543369a8dce480928febb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:04.790425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad9e1-fac6-4dc1-87e4-124f1a7afeab None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.790745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad9e1-fac6-4dc1-87e4-124f1a7afeab None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.791021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad9e1-fac6-4dc1-87e4-124f1a7afeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.793711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28c1b68378d4e6293b97c6df0c5b256', 'request_id': 'req-a65295e4-bad2-4eb0-883c-9f15e62885b0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.800756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28c1b68378d4e6293b97c6df0c5b256', 'request_id': 'req-a65295e4-bad2-4eb0-883c-9f15e62885b0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.803627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:04.806361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28c1b68378d4e6293b97c6df0c5b256', 'request_id': 'req-a65295e4-bad2-4eb0-883c-9f15e62885b0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.820934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-437ad9e1-fac6-4dc1-87e4-124f1a7afeab None None] MFA Rules not processed for user `cd85cd2a8250456699fdc7a5abfc7e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:04.822146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-437ad9e1-fac6-4dc1-87e4-124f1a7afeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.886748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1035/2065] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:04.888568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:04.888862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:04.889293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:04.909802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:04.911045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] The token cache is being invalidate because project e28c1b68378d4e6293b97c6df0c5b256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:04.911527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.911611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.912006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:04.916698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1031/2066] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:04 2022] DELETE /identity/v3/projects/e28c1b68378d4e6293b97c6df0c5b256 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:04.917570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.919883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.977895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1036/2067] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:04.978828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:04.984048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:04.991198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65295e4-bad2-4eb0-883c-9f15e62885b0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:04.997969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3960c47-466e-4156-84cb-86635ca2b65f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:05.004543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:05.005291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:05.005644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:05.006050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] PATH_INFO: `/v3/users/745eb882429b4807a87ab051ec5abfd5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:05.007489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745eb882429b4807a87ab051ec5abfd5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:05.009761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:05.045758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:05.046382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:05.046661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:05.047340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:05.048775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:05.060469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:05.061914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:05.070769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1032/2068] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:05.071634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:05.072934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:05.130462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5748d-a9f4-4c32-b78e-2365917114d3 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:05.134560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:05.135199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:05.135481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:05.135757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:05.145594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:05.147070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:05.157769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745eb882429b4807a87ab051ec5abfd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.158464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745eb882429b4807a87ab051ec5abfd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.159273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745eb882429b4807a87ab051ec5abfd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.159680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1033/2069] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:05.172697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745eb882429b4807a87ab051ec5abfd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.219672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745eb882429b4807a87ab051ec5abfd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.234864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1037/2070] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:04 2022] DELETE /identity/v3/users/745eb882429b4807a87ab051ec5abfd5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:05.266452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:05.515422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:05.627218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:05.627218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:05.656734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96433-3b8f-458e-b3b0-8b8ec54f8120 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:05.735491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:05.736156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:05.736434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:05.736728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] PATH_INFO: `/v3/projects/c7d1719b0a7e40ce9ebf47d3d7343f94` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:05.737888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d1719b0a7e40ce9ebf47d3d7343f94)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:05.739877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:05.789128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:05.790604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:05.820788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1d9d4-e816-40a5-8107-e1151897a954 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:05.827289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:05.828018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:05.828360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:05.829369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] PATH_INFO: `/v3/projects/cbf78faa73db40b5963a5a6cc24759e2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:05.831055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf78faa73db40b5963a5a6cc24759e2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:05.832989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:05.887532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d1719b0a7e40ce9ebf47d3d7343f94', 'request_id': 'req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.894427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d1719b0a7e40ce9ebf47d3d7343f94', 'request_id': 'req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.900265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d1719b0a7e40ce9ebf47d3d7343f94', 'request_id': 'req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.968807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf78faa73db40b5963a5a6cc24759e2', 'request_id': 'req-86451691-061c-4c36-aea4-9e364214c738'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:05.974233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf78faa73db40b5963a5a6cc24759e2', 'request_id': 'req-86451691-061c-4c36-aea4-9e364214c738'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.041903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] The token cache is being invalidate because project c7d1719b0a7e40ce9ebf47d3d7343f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:06.042462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.042955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.045370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1034/2071] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:05 2022] DELETE /identity/v3/projects/c7d1719b0a7e40ce9ebf47d3d7343f94 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:06.049090 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.050627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:06.116152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf78faa73db40b5963a5a6cc24759e2', 'request_id': 'req-86451691-061c-4c36-aea4-9e364214c738'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.116860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca0525-591d-4cb6-8905-ea1dd8a8b04d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.131284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] The token cache is being invalidate because project cbf78faa73db40b5963a5a6cc24759e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:06.131481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.132144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-86451691-061c-4c36-aea4-9e364214c738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.134098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1038/2072] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:05 2022] DELETE /identity/v3/projects/cbf78faa73db40b5963a5a6cc24759e2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:06.139379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5eca7-b096-4231-ba3f-06bfb9d8c497 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.139688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5eca7-b096-4231-ba3f-06bfb9d8c497 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.139940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5eca7-b096-4231-ba3f-06bfb9d8c497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.161140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7ec5eca7-b096-4231-ba3f-06bfb9d8c497 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:06.166624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7ec5eca7-b096-4231-ba3f-06bfb9d8c497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:06.180346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.181658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.181658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.181974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] PATH_INFO: `/v3/users/c7e0a1cab9c9454481d43df065e15b7f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.192897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e0a1cab9c9454481d43df065e15b7f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.195303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.227794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1039/2073] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:06.237487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.237666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.238005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.257789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:06.259023 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:06.267663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1040/2074] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:06.271727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.281486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b0d13-c7b2-4f81-ab48-a456b84e9f8e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.286345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.287027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.287377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.287656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.288367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:06.288666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.290276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.302354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1041/2075] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:06.306659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.316298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9685-f288-462d-954c-a1a71db88296 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.320997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.321581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.321856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.322126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.322801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.324717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.404519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e0a1cab9c9454481d43df065e15b7f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.405242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e0a1cab9c9454481d43df065e15b7f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.412549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e0a1cab9c9454481d43df065e15b7f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.420038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1042/2076] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:06.423812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.426200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e0a1cab9c9454481d43df065e15b7f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.489201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b480f-4559-441f-a7e4-8c85e184a879 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.494003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.494623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.494966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.495248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.495914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.499013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.513837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e0a1cab9c9454481d43df065e15b7f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:06.520759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1035/2077] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:06 2022] DELETE /identity/v3/users/c7e0a1cab9c9454481d43df065e15b7f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:06.600367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1043/2078] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:06 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:06.604341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.605769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:06.617375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:06.672391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9372f23-607d-4c08-b3ef-036ca1ecf4be admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.677084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.677743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.678050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.678306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.679033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.680645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.691379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1036/2079] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:06.695593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.706174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74192a-a6c9-41e3-9239-bf7d4d4ff72f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.711153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.711774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.712093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.712549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.713247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.714955 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c120e3-fd61-4f89-b850-267ae74dc13f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.726300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1044/2080] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:06.730638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.742187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97341-039b-4687-a091-a0d4e3873689 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:06.746890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:06.748113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.748397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.748672 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] PATH_INFO: `/v3/projects/eb9674939f8d4e32816ae48967ca0c4c/users/7403a268da4140338df2c02da8a3e3ae/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.764293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9674939f8d4e32816ae48967ca0c4c, user_id=7403a268da4140338df2c02da8a3e3ae, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:06.767010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:06.791484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:06.843143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1037/2081] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:06 2022] PUT /identity/v3/projects/eb9674939f8d4e32816ae48967ca0c4c/users/7403a268da4140338df2c02da8a3e3ae/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:06.853777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:06.855193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:06.855193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:06.893817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] MFA Rules not processed for user `7403a268da4140338df2c02da8a3e3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:06.895066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:06.984204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1045/2082] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:06.991560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:06.993342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.148393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64978f-d498-402a-8489-aa45042cebe0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.148393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.148393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.148393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.151633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.151633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.151633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.151633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1038/2083] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:07.153271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:07.216622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d5c9f-ddf1-43a0-938a-fcd8f0c7f386 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.221265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.221899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.222179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.222454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] PATH_INFO: `/v3/users/7403a268da4140338df2c02da8a3e3ae` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.223669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7403a268da4140338df2c02da8a3e3ae)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.225589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.263605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:07.265281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.283531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a1373-a9d8-4359-aadf-a558bd577fb5 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.289870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.290524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.302899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.302899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] PATH_INFO: `/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.302899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d2a4f07ad443f38f7265e6e1c91f30)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.302899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.520751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7403a268da4140338df2c02da8a3e3ae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.521226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d2a4f07ad443f38f7265e6e1c91f30', 'request_id': 'req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.521428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7403a268da4140338df2c02da8a3e3ae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.522089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7403a268da4140338df2c02da8a3e3ae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.528341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d2a4f07ad443f38f7265e6e1c91f30', 'request_id': 'req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.535841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7403a268da4140338df2c02da8a3e3ae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.536093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d2a4f07ad443f38f7265e6e1c91f30', 'request_id': 'req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.595951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-268c0d82-5b1b-444c-af2e-3777d3cfd983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7403a268da4140338df2c02da8a3e3ae'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.609300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1046/2084] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:07 2022] DELETE /identity/v3/users/7403a268da4140338df2c02da8a3e3ae => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:07.613662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.613945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.614218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.632643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:07.635392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.692068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1047/2085] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:07.703350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] The token cache is being invalidate because project 57d2a4f07ad443f38f7265e6e1c91f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:07.704496 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.704792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:07.704904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8863ed88-77c0-4c7e-85ed-7be1b1d2e02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:07.705513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.707110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1039/2086] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:07 2022] DELETE /identity/v3/projects/57d2a4f07ad443f38f7265e6e1c91f30 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:07.711881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a0c5-23d3-4d79-a57d-00e5ab54091b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.712171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a0c5-23d3-4d79-a57d-00e5ab54091b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.712452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a0c5-23d3-4d79-a57d-00e5ab54091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.734207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6933a0c5-23d3-4d79-a57d-00e5ab54091b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:07.735498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6933a0c5-23d3-4d79-a57d-00e5ab54091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.748964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1040/2087] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:07.756537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.756830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.761883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.766345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce653-ea90-4637-89e6-5c2a554cea66 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.770611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.771434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.771811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.772186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.776672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.790352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:07.791857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:07.794301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.796091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.800879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1041/2088] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:07.805211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:07.809417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1048/2089] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:07.815409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc6a5-8d34-4871-8176-c52f242885f7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.820357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.821013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.821300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.821812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.822518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:07.822874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.824491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.839328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1042/2090] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:07.847374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:07.858982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33fd5-43c2-4f66-ad2e-9ea10c08e8b1 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:07.875465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:07.876327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:07.876920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:07.877368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:07.878406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:07.881635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:07.985945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1049/2091] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:07 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:07.990261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.001985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009042c9-4c05-4224-8446-51a9b2cde63f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.080176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.081157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.081332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.081600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.082376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.084698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.177419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1043/2092] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:07 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:08.181548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.192111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9adc2-e61d-4665-bfd2-a1d5d91b94f6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.197031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.197674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.197957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.198254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.198990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.200582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.210603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1050/2093] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:08.214584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.225887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c6f6-177c-40ee-ae51-fed83e3a5006 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.231693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.233617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.233756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.234015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.234734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.236351 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.247850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1044/2094] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:08.252144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.267791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee4844-7f14-4cac-b4cd-ad26a9a64a5d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.267791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.267791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.267791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.268120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] PATH_INFO: `/v3/projects/a999c1059bcf4ee38e16763f86f404d5/users/01b40e231c8d42aa95795c3d52403350/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.269108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.272412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:08.284933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a999c1059bcf4ee38e16763f86f404d5, user_id=01b40e231c8d42aa95795c3d52403350, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.287643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecf7f1-ed0c-4966-98f9-7f7f72fe03e8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.290971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c79f-6767-4963-90f5-a190a49d89f7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.296825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.297471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.297744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.298015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] PATH_INFO: `/v3/projects/eb9674939f8d4e32816ae48967ca0c4c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.299215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9674939f8d4e32816ae48967ca0c4c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.301109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.399769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1051/2095] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:08 2022] PUT /identity/v3/projects/a999c1059bcf4ee38e16763f86f404d5/users/01b40e231c8d42aa95795c3d52403350/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:08.412611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.413026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.413384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.420573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9674939f8d4e32816ae48967ca0c4c', 'request_id': 'req-0efa7b1f-9b53-441a-8886-c01c7c33e04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:08.427057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9674939f8d4e32816ae48967ca0c4c', 'request_id': 'req-0efa7b1f-9b53-441a-8886-c01c7c33e04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:08.432592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9674939f8d4e32816ae48967ca0c4c', 'request_id': 'req-0efa7b1f-9b53-441a-8886-c01c7c33e04d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:08.442195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] MFA Rules not processed for user `01b40e231c8d42aa95795c3d52403350`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:08.443522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:08.518838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] The token cache is being invalidate because project eb9674939f8d4e32816ae48967ca0c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:08.519232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:08.520071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0efa7b1f-9b53-441a-8886-c01c7c33e04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:08.521694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1052/2096] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:08.522035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1045/2097] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:08 2022] DELETE /identity/v3/projects/eb9674939f8d4e32816ae48967ca0c4c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:08.527615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.528069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27deb-5306-4eb5-a12e-5ae2afb6ac24 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.528481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27deb-5306-4eb5-a12e-5ae2afb6ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.528763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc27deb-5306-4eb5-a12e-5ae2afb6ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.536024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:08.565426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-adc27deb-5306-4eb5-a12e-5ae2afb6ac24 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:08.566660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-adc27deb-5306-4eb5-a12e-5ae2afb6ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:08.603587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd26b-830e-40ea-b9bc-d617343b0822 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.608698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.609413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.610060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.610060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.610617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.612617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.651497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1046/2098] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:08.659850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.660134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.660410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.679306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:08.680498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:08.688412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1047/2099] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:08.692557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.702621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd13a4-3612-4974-9891-eb491893b8d6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.707889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.708503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.708784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.709059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.709750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:08.710054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.711676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.714421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1053/2100] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:08.720435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.722996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:08.725252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1048/2101] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:08.729408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.740452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906950f-b619-4856-b7a7-e8e5d952764d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.791565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213feca1-606a-4fc7-8d16-beb632cb2946 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.797588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.799015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.799421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.799708 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.800952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.801089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.801346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.801629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.801901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.802564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.802675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.804538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.879208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1054/2102] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:08.880983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.891362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171ad9f-199b-446b-bb06-b16b429e2904 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.896207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.896879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.897442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.897996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.898785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.904617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.911167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1055/2103] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:08.915073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.925004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776176-97a9-4120-93e9-ef49e83e016d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:08.933162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1049/2104] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:08.933286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:08.933286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:08.933286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:08.933286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:08.933642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:08.934422 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.934643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:08.950025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1056/2105] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:08.951980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:08.969639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0672b9-7633-415c-a6e5-421e16e9869d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.029728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c01a5f-4c7a-46af-800b-3600f8ecae8d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.037018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.037661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.037938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.038367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.039168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.041120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.041541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.042530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.042530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.042810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] PATH_INFO: `/v3/projects/216cb127b10d494589dcdd16029b0128/users/6a04394b0e5b400a8bfbe45374ca8be0/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.061381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] RBAC: Authorizing `identity:create_grant(project_id=216cb127b10d494589dcdd16029b0128, user_id=6a04394b0e5b400a8bfbe45374ca8be0, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.064410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d006-a875-4889-9ab6-2aaf7787899d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.110924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:09.162752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1050/2106] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:08 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:09.164072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.173278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1057/2107] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:08 2022] PUT /identity/v3/projects/216cb127b10d494589dcdd16029b0128/users/6a04394b0e5b400a8bfbe45374ca8be0/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:09.183461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd83fb-435d-402b-a2e0-f683bc0ab73a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.184594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.184880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.185162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.246068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] MFA Rules not processed for user `6a04394b0e5b400a8bfbe45374ca8be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:09.247724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:09.266403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.267209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.267594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.267979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.269120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.271427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.285395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1051/2108] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:09.290615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.305571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d3604-c558-4cab-a65b-01c8c1311bed admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.316844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.317531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.318149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.318435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.319178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.320824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.333812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1052/2109] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:09.338574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.340614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1058/2110] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:09.345355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.349886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ffd9e-71f3-4cb2-a5f5-e2ef00a329b9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.354994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.355737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.356025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.356299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] PATH_INFO: `/v3/projects/c6dc3b24b0654e4c8ef9c927149f3f1e/users/fb5d0f2102774251825138e6c0f63740/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.359902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277e286-0ef2-4973-8aba-cca95f3b592b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.369893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.370826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.371175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.371646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.372508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.374010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6dc3b24b0654e4c8ef9c927149f3f1e, user_id=fb5d0f2102774251825138e6c0f63740, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.375780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.376925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c42ba-84a9-420b-ba1e-08232173b651 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.453686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1053/2111] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:09 2022] PUT /identity/v3/projects/c6dc3b24b0654e4c8ef9c927149f3f1e/users/fb5d0f2102774251825138e6c0f63740/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:09.464597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.464885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.465159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.496230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] MFA Rules not processed for user `fb5d0f2102774251825138e6c0f63740`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:09.499093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:09.502738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1059/2112] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:09 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:09.506756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.595482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1054/2113] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:09.608466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502b750-19b7-497e-a3ff-9024e8b8b32c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.612853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.613561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.614186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.614470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.614753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:09.614919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.616165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.618381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.720164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668e62c-0776-482c-bc59-eb0f9657b562 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.728860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.729620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.729965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.730307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.742907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.743559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1060/2114] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:09 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:09.743867 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.751240 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.755224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1055/2115] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:09.767688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5e6c5-30ef-4fd8-ab93-29c9da462640 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.776183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.776183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.776183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.776183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.776865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.779582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.793485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1061/2116] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:09.798199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.814585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea848e-bf7a-48f0-8fc7-38291546ac98 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:09.824323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:09.825696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:09.826184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:09.830243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] PATH_INFO: `/v3/projects/10f474f3b7214f13a41f92682c67143a/users/5c5af62de0c14d4e849d462e2f0c8012/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:09.864123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f474f3b7214f13a41f92682c67143a, user_id=5c5af62de0c14d4e849d462e2f0c8012, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:09.866977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:09.963523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1056/2117] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:09 2022] PUT /identity/v3/projects/10f474f3b7214f13a41f92682c67143a/users/5c5af62de0c14d4e849d462e2f0c8012/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:09.968598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:09.979732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b312-f953-40c7-a3e4-7f27362920fa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:10.039729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:10.040640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:10.041066 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:10.041409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:10.042105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:10.043729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e89c-9b66-469b-aa5b-e7953b4a725d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:10.053921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1062/2118] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:10.058307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:10.068705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068e5df-8c6e-44b8-977a-0e93e6ea4b74 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:10.073315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:10.073966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:10.074323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:10.074599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] PATH_INFO: `/v3/projects/10f474f3b7214f13a41f92682c67143a/users/5c5af62de0c14d4e849d462e2f0c8012/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:10.077107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f474f3b7214f13a41f92682c67143a, user_id=5c5af62de0c14d4e849d462e2f0c8012, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:10.079905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:10.089749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1057/2119] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:10 2022] PUT /identity/v3/projects/10f474f3b7214f13a41f92682c67143a/users/5c5af62de0c14d4e849d462e2f0c8012/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:10.100895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:10.101180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:10.101455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:10.129198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] MFA Rules not processed for user `5c5af62de0c14d4e849d462e2f0c8012`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:10.130390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:10.202077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1063/2120] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:10.592240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:10.595968 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:10.655964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2369f6c-d738-4c37-ae45-15529566e068 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:10.659595 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:10.660209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:10.660487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:10.660760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:10.669931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:10.672011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:10.681563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1058/2121] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:11.234973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:11.657253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:12.038740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:12.049051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b73ee-5811-4fbe-b1d4-7cd545e8ea47 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:12.052797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:12.053442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:12.053722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:12.054004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:12.056239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:12.119230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:12.120641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac185af8-2302-4c39-be11-6de91188a1e5 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:12.130662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1064/2122] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:12.734492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:12.966931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:13.976136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:14.159932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:14.748330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:14.939281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:15.502639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:15.816711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:16.177010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:16.470853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:16.751293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:16.945159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:17.307750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:17.322769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c341494-6093-4f16-a6ef-c1d1dd5285cd service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:17.330336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:17.331118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:17.331469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:17.331845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:17.407441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:17.408801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24415d-1aff-4e4f-b643-428e2ba6755b service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:17.421895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1059/2123] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:17.625688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:17.728772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:18.200229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:18.270960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:18.607867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:18.720650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:19.002322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:19.276033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:19.689712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:21.478106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:21.478602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:21.478735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:21.498020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] MFA Rules not processed for user `596ac3649c7e46bdb494635c416c9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:21.499904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:21.567778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1065/2124] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:22.148547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:22.149095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:22.149095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:22.173303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:22.174523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:22.263696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1060/2125] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:22.313716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:22.315195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:22.364529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:22.413819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856efa6-3689-474e-876a-a0fc27eb4802 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:22.420321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:22.421080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:22.421506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:22.421891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:22.441392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:22.445099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f045b-a5de-4e84-acef-79f81fc78646 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:22.453043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1066/2126] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:12:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:12:23.168122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:23.225714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:23.255916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7fae4-2ac8-4d69-8441-622f10cb71d5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:23.261012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:23.261972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:23.262485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:23.263015 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] PATH_INFO: `/v3/users/01b40e231c8d42aa95795c3d52403350` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:23.264474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b40e231c8d42aa95795c3d52403350)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:23.267377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:23.517370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b40e231c8d42aa95795c3d52403350'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:23.518479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b40e231c8d42aa95795c3d52403350'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:23.529948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b40e231c8d42aa95795c3d52403350'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:23.562642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b40e231c8d42aa95795c3d52403350'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:23.752380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b40e231c8d42aa95795c3d52403350'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:23.768381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1061/2127] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:23 2022] DELETE /identity/v3/users/01b40e231c8d42aa95795c3d52403350 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:23.773320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:23.774224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:23.774996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:23.801360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:23.802914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:23.926390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1067/2128] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:23.934368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:23.936379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:24.029724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0e7eb-af31-43ce-a428-6f60c4a1ce2a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:24.034156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:24.034907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:24.035268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:24.035619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:24.048004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:24.049568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:24.061506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1062/2129] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:12:24.555724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:24.558881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:24.582008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a206167-bcee-4faf-89cc-da56de9eb626 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:24.588149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:24.589034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:24.589550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:24.589810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] PATH_INFO: `/v3/projects/a999c1059bcf4ee38e16763f86f404d5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:24.592010 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a999c1059bcf4ee38e16763f86f404d5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:24.595002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:24.908612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a999c1059bcf4ee38e16763f86f404d5', 'request_id': 'req-ac6bee52-7641-4b26-9ace-89a643a85fdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:24.925051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a999c1059bcf4ee38e16763f86f404d5', 'request_id': 'req-ac6bee52-7641-4b26-9ace-89a643a85fdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.045910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a999c1059bcf4ee38e16763f86f404d5', 'request_id': 'req-ac6bee52-7641-4b26-9ace-89a643a85fdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.089061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] The token cache is being invalidate because project a999c1059bcf4ee38e16763f86f404d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:25.092013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.096821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.099489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1068/2130] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:24 2022] DELETE /identity/v3/projects/a999c1059bcf4ee38e16763f86f404d5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:25.104941 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:25.141293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1a7de-4400-46ae-a430-a849396c5fcf service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:25.301258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:25.308027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:25.308684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:25.308965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:25.309343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] PATH_INFO: `/v3/users/6a04394b0e5b400a8bfbe45374ca8be0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:25.310642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a04394b0e5b400a8bfbe45374ca8be0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:25.315581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:25.317199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:25.320110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:25.359473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee52-7641-4b26-9ace-89a643a85fdb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:25.371419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:25.371419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:25.371419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:25.371419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] PATH_INFO: `/v3/users/fb5d0f2102774251825138e6c0f63740` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:25.373042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5d0f2102774251825138e6c0f63740)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:25.375508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:25.540449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a04394b0e5b400a8bfbe45374ca8be0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.540449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a04394b0e5b400a8bfbe45374ca8be0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.572060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a04394b0e5b400a8bfbe45374ca8be0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.616185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a04394b0e5b400a8bfbe45374ca8be0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.664682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:25.679477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5d0f2102774251825138e6c0f63740'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.680496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5d0f2102774251825138e6c0f63740'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.681363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5d0f2102774251825138e6c0f63740'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.719755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5d0f2102774251825138e6c0f63740'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.745316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cf60e76d-75cb-48f6-929e-8d6d70e681fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a04394b0e5b400a8bfbe45374ca8be0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.768459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1063/2131] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:25 2022] DELETE /identity/v3/users/6a04394b0e5b400a8bfbe45374ca8be0 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:25.877035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5d0f2102774251825138e6c0f63740'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:25.895950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1069/2132] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:25 2022] DELETE /identity/v3/users/fb5d0f2102774251825138e6c0f63740 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:25.901395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:25.902114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:25.902829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:25.927368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:25.928614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:26.075526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1064/2133] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:26.158034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:26.160189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:26.316862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355aab6f-7f59-45fd-b6e1-19bf44d3c2d0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:26.329507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:26.330681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:26.331522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:26.332044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:26.360714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:26.365694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:26.410797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1070/2134] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:26.866908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:26.866908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:26.893774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71a05-581e-433b-826f-44ded9a11ad6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:26.910113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:26.913383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:26.913836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:26.914260 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] PATH_INFO: `/v3/projects/216cb127b10d494589dcdd16029b0128` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:26.916376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216cb127b10d494589dcdd16029b0128)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:26.918925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:27.143768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216cb127b10d494589dcdd16029b0128', 'request_id': 'req-00e68787-9c42-43a3-b684-1747167456a7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.151308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216cb127b10d494589dcdd16029b0128', 'request_id': 'req-00e68787-9c42-43a3-b684-1747167456a7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.157748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216cb127b10d494589dcdd16029b0128', 'request_id': 'req-00e68787-9c42-43a3-b684-1747167456a7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.197735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:27.201402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:27.228228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a6b54-1731-4080-b001-f6123652fecd service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:27.288439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:27.296124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] The token cache is being invalidate because project 216cb127b10d494589dcdd16029b0128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:27.296884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.299981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.303438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1065/2135] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:26 2022] DELETE /identity/v3/projects/216cb127b10d494589dcdd16029b0128 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:27.314870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:27.316623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:27.362816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:27.363803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:27.364282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:27.364720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] PATH_INFO: `/v3/projects/c6dc3b24b0654e4c8ef9c927149f3f1e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:27.368919 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6dc3b24b0654e4c8ef9c927149f3f1e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:27.371768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:27.440007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e68787-9c42-43a3-b684-1747167456a7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:27.448891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:27.449533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:27.449820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:27.450124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] PATH_INFO: `/v3/users/5c5af62de0c14d4e849d462e2f0c8012` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:27.451375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5af62de0c14d4e849d462e2f0c8012)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:27.454097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:27.608317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6dc3b24b0654e4c8ef9c927149f3f1e', 'request_id': 'req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.634810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6dc3b24b0654e4c8ef9c927149f3f1e', 'request_id': 'req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.648889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:27.712599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5af62de0c14d4e849d462e2f0c8012'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.716671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5af62de0c14d4e849d462e2f0c8012'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.731269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5af62de0c14d4e849d462e2f0c8012'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.739018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6dc3b24b0654e4c8ef9c927149f3f1e', 'request_id': 'req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.765677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] The token cache is being invalidate because project c6dc3b24b0654e4c8ef9c927149f3f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:27.766280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.769155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.774880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1071/2136] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:27 2022] DELETE /identity/v3/projects/c6dc3b24b0654e4c8ef9c927149f3f1e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:27.780669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5af62de0c14d4e849d462e2f0c8012'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.859863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06937eb4-2230-48ef-9dc0-9a467d19bbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5af62de0c14d4e849d462e2f0c8012'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:27.877946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1066/2137] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:27 2022] DELETE /identity/v3/users/5c5af62de0c14d4e849d462e2f0c8012 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:29.295629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:29.299043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:29.445925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9223f9b-5aa0-44d5-ab87-7fac31f4cd98 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:29.587131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:29.587887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:29.588912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:29.589206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] PATH_INFO: `/v3/projects/10f474f3b7214f13a41f92682c67143a` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:29.591325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f474f3b7214f13a41f92682c67143a)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:29.595318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:29.735140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f474f3b7214f13a41f92682c67143a', 'request_id': 'req-2792549c-808b-4c0b-b9fe-69f9f34d6c98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:29.744523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f474f3b7214f13a41f92682c67143a', 'request_id': 'req-2792549c-808b-4c0b-b9fe-69f9f34d6c98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:29.812168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f474f3b7214f13a41f92682c67143a', 'request_id': 'req-2792549c-808b-4c0b-b9fe-69f9f34d6c98'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:29.840615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] The token cache is being invalidate because project 10f474f3b7214f13a41f92682c67143a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:29.841276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:29.842322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2792549c-808b-4c0b-b9fe-69f9f34d6c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:29.846045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1072/2138] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:29 2022] DELETE /identity/v3/projects/10f474f3b7214f13a41f92682c67143a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:29.854568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:29.855525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:29.855809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:29.879259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:29.880517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:29.946240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1067/2139] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:29.955986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:29.958856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:29.958856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:29.976936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:29.978167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:29.986436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1073/2140] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:29.991265 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.002873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd2d5-b543-4640-9efc-b8b6c4b35629 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.008060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.009319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.009748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.010167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.011055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:30.011720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.013374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.027290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1068/2141] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:12:30.032494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.042329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd476b79-68a0-434c-98aa-b98a618f6577 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.047428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.048104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.048456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.048737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.049514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.051694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.135664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:30.146753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1074/2142] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:30.150161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.165257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b267-caf4-463f-9730-2737dd8fdb4b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.169891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:30.244592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.246041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.247021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.247492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.248344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.258142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.371091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1069/2143] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:30 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:30.375795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.404493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc11e-561c-478c-b6fc-ca46bfba407a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.420688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.423806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.424671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.426460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.434590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.442523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.477512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1075/2144] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:30.477928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.491540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5e9cd-8c52-4ad8-bfda-bb4420c476ff admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.496616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.497240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.497524 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.497804 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.498889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.500818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e5202-c19f-47c0-b48d-c5e20e808219 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.516682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1070/2145] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:30.520844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:30.537192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15c9a9-ca3f-4913-88e3-d558df495213 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:30.552979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:30.554339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.554339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.554339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] PATH_INFO: `/v3/projects/be537f906fa5468d902f7932c53da0c6/users/ca5138ec27de43e2a2807223e9d15079/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.579910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=be537f906fa5468d902f7932c53da0c6, user_id=ca5138ec27de43e2a2807223e9d15079, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:30.583077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:30.665642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1076/2146] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:30 2022] PUT /identity/v3/projects/be537f906fa5468d902f7932c53da0c6/users/ca5138ec27de43e2a2807223e9d15079/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:30.681900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:30.682248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:30.682469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:30.722835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] MFA Rules not processed for user `ca5138ec27de43e2a2807223e9d15079`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:30.724098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:30.863205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1071/2147] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:30.867905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:31.073128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227f2a6-ff93-471e-97cf-51f4f3fecaec admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:31.087896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:31.088561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:31.088829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:31.089114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:31.089797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:31.091849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:31.194357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1077/2148] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:30 2022] POST /identity/v3/projects => generated 379 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:31.198148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:31.217457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4218ad7-027e-47aa-b109-5f3117be4ab5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:31.293033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:31.294107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:31.294505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:31.295084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:31.295854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:31.298812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:31.739182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1072/2149] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:31 2022] POST /identity/v3/users => generated 290 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:12:31.742792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:31.764277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669003-9cb5-4218-bad0-7dfd14bde415 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:31.772358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:31.773263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:31.773544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:31.773826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:31.774699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:31.776968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:31.793237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1078/2150] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:31.794160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:31.804543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:31.810190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f1fcd-f10f-4f32-a186-db757863eaa9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:31.818127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:31.819356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:31.819832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:31.820281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:31.821298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:31.823413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b674ea4-fd5a-498b-9923-e82600532d66 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:31.838817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1073/2151] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:31.843939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:31.856341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ffd3e-5495-4ce8-8b70-8591318bdbbc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:31.864820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:31.865797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:31.866245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:31.866731 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] PATH_INFO: `/v3/projects/2e5c836458334b50b16696c0a236d94b/users/937337610b7c430cb16811eb7f190daa/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:31.886546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5c836458334b50b16696c0a236d94b, user_id=937337610b7c430cb16811eb7f190daa, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:31.889435 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:31.989778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1079/2152] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:31 2022] PUT /identity/v3/projects/2e5c836458334b50b16696c0a236d94b/users/937337610b7c430cb16811eb7f190daa/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:32.002385 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:32.003111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:32.003522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:32.037803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] MFA Rules not processed for user `937337610b7c430cb16811eb7f190daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:32.038668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:32.119222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1074/2153] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:32.130886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:32.210667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8cfe-c649-459d-a154-03316bea0289 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:32.217654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:32.219661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:32.219954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:32.220234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:32.221788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:32.224169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:32.362642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:32.370880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1080/2154] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:32 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:32.374921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:32.394585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8febf1-d5f3-4318-8e92-1422cdb9979f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:32.570224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:32.571337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:32.571625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:32.571895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:32.572847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:32.574999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:32.678458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1075/2155] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:32 2022] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:32.681614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:32.697891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1d0f-f9a8-412d-a69c-bb683f3d3469 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:32.717055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:32.718846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:32.719635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:32.719635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:32.720449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:32.723085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:32.738857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1081/2156] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:32.742897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:32.758410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f5c71-0af1-4b08-9fb9-51be4d70f3d6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:32.768692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:32.770919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:32.770919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:32.770919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] PATH_INFO: `/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d/users/f194f12d3f82424d8106a15bce821546/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:32.794199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1fda2aca3a4376a424a070d1f17b7d, user_id=f194f12d3f82424d8106a15bce821546, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:32.799405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:32.921606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1076/2157] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:32 2022] PUT /identity/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d/users/f194f12d3f82424d8106a15bce821546/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:32.923293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:32.942159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed7813-db0f-4695-8b39-c34875ce9ead admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:33.112309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:33.115044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.115044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.115044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.115044 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:33.118432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a298a-7e87-48d2-b857-5e814a52315e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:33.149852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1082/2158] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:33.154796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:33.198736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a62ae4-1567-448f-8afe-58e141ecba12 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:33.201303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:33.202000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.208339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.208692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] PATH_INFO: `/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d/users/f194f12d3f82424d8106a15bce821546/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.212305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1fda2aca3a4376a424a070d1f17b7d, user_id=f194f12d3f82424d8106a15bce821546, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:33.217661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:33.249467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1077/2159] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:33 2022] PUT /identity/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d/users/f194f12d3f82424d8106a15bce821546/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:33.251882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.252272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.252647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.316644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] MFA Rules not processed for user `f194f12d3f82424d8106a15bce821546`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:33.319390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:33.468528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1083/2160] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:33.475904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:33.478162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:33.556059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:33.593798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564a872-9844-4eb1-a04b-999c72737462 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:33.597805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:33.598519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.598901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.599620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.610621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:33.612236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:33.629464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1078/2161] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:33.735137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:33.736741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:33.760078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3fc4-c315-4d30-9ae6-8c0fd33eca38 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:33.767502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:33.767502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:33.767744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:33.768208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:33.850602 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:33.852190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73746f0-6b1a-45f8-9af2-13cfe0f6d81f service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:33.876350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1084/2162] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:38.451587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:38.518162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa4b8c-c430-47a9-98da-1f91c875449a service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:38.522955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:38.523600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:38.523900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:38.524157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] PATH_INFO: `/v3/users/ca5138ec27de43e2a2807223e9d15079` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:38.525327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5138ec27de43e2a2807223e9d15079)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:38.527302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:38.759302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5138ec27de43e2a2807223e9d15079'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:38.759882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5138ec27de43e2a2807223e9d15079'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:38.769727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5138ec27de43e2a2807223e9d15079'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:38.789243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5138ec27de43e2a2807223e9d15079'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:38.862383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5138ec27de43e2a2807223e9d15079'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:38.871319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1079/2163] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:38 2022] DELETE /identity/v3/users/ca5138ec27de43e2a2807223e9d15079 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:38.876262 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:38.876994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:38.876994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:38.899182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:38.906150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:38.906150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:38.971670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1085/2164] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:38.987641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:38.987641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:39.059243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc664-f779-483c-a299-a0f98fcc7132 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:39.063812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:39.064645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:39.065045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:39.065430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:39.076669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:39.078993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:39.084569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:39.090740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1080/2165] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:39.718672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:39.720361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:39.744428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107c38-f4ab-4715-930c-ba71ee90cf81 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:39.759574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:39.760471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:39.760858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:39.761286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] PATH_INFO: `/v3/projects/be537f906fa5468d902f7932c53da0c6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:39.762869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be537f906fa5468d902f7932c53da0c6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:39.765083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:39.968829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be537f906fa5468d902f7932c53da0c6', 'request_id': 'req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:39.986515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be537f906fa5468d902f7932c53da0c6', 'request_id': 'req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.057604 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be537f906fa5468d902f7932c53da0c6', 'request_id': 'req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.080951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] The token cache is being invalidate because project be537f906fa5468d902f7932c53da0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:40.081616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.083514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.085672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1086/2166] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:39 2022] DELETE /identity/v3/projects/be537f906fa5468d902f7932c53da0c6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:40.090376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:40.103572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a1549-c1c6-42a7-94e6-8fc3ecd0d4f8 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:40.201877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:40.203711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:40.204120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:40.204398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] PATH_INFO: `/v3/users/937337610b7c430cb16811eb7f190daa` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:40.205992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937337610b7c430cb16811eb7f190daa)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:40.208473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:40.403023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937337610b7c430cb16811eb7f190daa'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.403877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937337610b7c430cb16811eb7f190daa'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.411608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937337610b7c430cb16811eb7f190daa'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.425511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937337610b7c430cb16811eb7f190daa'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.510064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937337610b7c430cb16811eb7f190daa'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:40.518993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1081/2167] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:40 2022] DELETE /identity/v3/users/937337610b7c430cb16811eb7f190daa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:41.126189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:41.130271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:41.153042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef197c-bc01-4feb-9f45-ee7a3f76da7f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:41.259418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:41.260216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:41.260559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:41.260929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] PATH_INFO: `/v3/projects/2e5c836458334b50b16696c0a236d94b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:41.262246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5c836458334b50b16696c0a236d94b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:41.265515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:41.411842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:41.425669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5c836458334b50b16696c0a236d94b', 'request_id': 'req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:41.435999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5c836458334b50b16696c0a236d94b', 'request_id': 'req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:41.504766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5c836458334b50b16696c0a236d94b', 'request_id': 'req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:41.546836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] The token cache is being invalidate because project 2e5c836458334b50b16696c0a236d94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:41.546836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:41.551019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a333e9a8-1aea-4326-9889-4e6ee97f8ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:41.558065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:41.559977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:41.561496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1087/2168] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:41 2022] DELETE /identity/v3/projects/2e5c836458334b50b16696c0a236d94b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:41.576191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f76a7-1c1b-4163-a0b8-20607f8cd035 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:41.713886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:41.714538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:41.717643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:41.720243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] PATH_INFO: `/v3/users/f194f12d3f82424d8106a15bce821546` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:41.722466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f194f12d3f82424d8106a15bce821546)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:41.726947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:41.781041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:42.002250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f194f12d3f82424d8106a15bce821546'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:42.003144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f194f12d3f82424d8106a15bce821546'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:42.010875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f194f12d3f82424d8106a15bce821546'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:42.044624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f194f12d3f82424d8106a15bce821546'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:42.117137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f194f12d3f82424d8106a15bce821546'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:42.126308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1082/2169] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:41 2022] DELETE /identity/v3/users/f194f12d3f82424d8106a15bce821546 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:42.857769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74f7c3-6574-4aaa-81b8-510aac1ba6db None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:42.858403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74f7c3-6574-4aaa-81b8-510aac1ba6db None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:42.858403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74f7c3-6574-4aaa-81b8-510aac1ba6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:42.892870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6d74f7c3-6574-4aaa-81b8-510aac1ba6db None None] MFA Rules not processed for user `4e10b618c9d349b1835c80cf30f170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:42.893874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d74f7c3-6574-4aaa-81b8-510aac1ba6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:42.991648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:42.993378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:42.998691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1088/2170] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:43.169731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8931-5e48-4d2b-b9b5-fb9cefd5e96b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:43.183693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:43.184855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:43.185143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:43.185433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] PATH_INFO: `/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:43.187956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1fda2aca3a4376a424a070d1f17b7d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:43.190438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:43.371029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1fda2aca3a4376a424a070d1f17b7d', 'request_id': 'req-996176ca-cd18-4f58-a85d-7645b557cc98'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:43.379248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1fda2aca3a4376a424a070d1f17b7d', 'request_id': 'req-996176ca-cd18-4f58-a85d-7645b557cc98'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:43.392155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1fda2aca3a4376a424a070d1f17b7d', 'request_id': 'req-996176ca-cd18-4f58-a85d-7645b557cc98'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:43.517661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] The token cache is being invalidate because project 1a1fda2aca3a4376a424a070d1f17b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:43.517897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:43.519300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-996176ca-cd18-4f58-a85d-7645b557cc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:43.528140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1083/2171] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:42 2022] DELETE /identity/v3/projects/1a1fda2aca3a4376a424a070d1f17b7d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:43.529751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:43.530276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:43.530817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:43.579075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:43.580479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:43.742075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1089/2172] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:43.751002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:43.751292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:43.751575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:43.792842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:43.795592 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:43.811193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1084/2173] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:43.813025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:43.828747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722331a-906c-4c3d-9687-2facc90d830a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:43.839957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:43.840458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:43.840738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:43.841405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:43.841715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:43.842019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:43.843893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:43.871258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1090/2174] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:12:43.876800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:43.899820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c71708-721f-4e21-8798-a91455f9cb34 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:43.909305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:43.912713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:43.912713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:43.912713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:43.912713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:43.914382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:44.013889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:44.022930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1085/2175] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:43 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:44.028325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:44.055379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a528d-621c-4917-9150-65b9b6a26160 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:44.208821 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:44.236357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:44.237497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:44.237789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:44.238068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:44.239324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:44.243194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:44.337641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1091/2176] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:44 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:44.341903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:44.353536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44154f-8c14-4e58-9685-eedf04560fb7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:44.364272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:44.364272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:44.364272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:44.364272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:44.364660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:44.365275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:44.382440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1086/2177] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:44.383961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:44.403568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a51c4-92d5-4c03-85bc-7ee6b092d0f9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:44.415793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:44.420446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:44.421391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:44.421678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:44.422415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:44.427195 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f6634-386c-45b0-94ce-24fa3f69415e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:44.468848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1092/2178] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:44.472881 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:44.491050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b45484-2327-445c-955a-c0c9e281be66 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:44.505316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:44.506026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:44.506387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:44.507890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] PATH_INFO: `/v3/projects/da5d7fa560f84b149f3adb68832ea8f9/users/0773a59520ff4f3fba7001517251c066/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:44.559588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5d7fa560f84b149f3adb68832ea8f9, user_id=0773a59520ff4f3fba7001517251c066, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:44.563416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:44.732917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1087/2179] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:44 2022] PUT /identity/v3/projects/da5d7fa560f84b149f3adb68832ea8f9/users/0773a59520ff4f3fba7001517251c066/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:44.755310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99054-df01-462f-a18e-184c6994db1e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:44.755310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99054-df01-462f-a18e-184c6994db1e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:44.755310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99054-df01-462f-a18e-184c6994db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:44.819089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-cdc99054-df01-462f-a18e-184c6994db1e None None] MFA Rules not processed for user `0773a59520ff4f3fba7001517251c066`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:44.820852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cdc99054-df01-462f-a18e-184c6994db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:45.119500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1093/2180] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:45.132108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:45.135149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:45.351198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79450499-49ee-4760-b8d8-74e374ba2dbe admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:45.364540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:45.364828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:45.365148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:45.366064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:45.396960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:45.399209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:45.432352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1088/2181] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:45.619053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5927c-c13a-4398-b31d-a3bef4e60e62 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:45.619338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5927c-c13a-4398-b31d-a3bef4e60e62 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:45.619621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5927c-c13a-4398-b31d-a3bef4e60e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:45.645186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-67c5927c-c13a-4398-b31d-a3bef4e60e62 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:45.646904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-67c5927c-c13a-4398-b31d-a3bef4e60e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:45.735034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1094/2182] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:45.755279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:45.757218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:45.988007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9703c3-716e-4bc6-b64a-8d0dbd996810 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:46.000695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:46.002585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:46.003223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:46.003786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:46.017096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:46.020061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:46.045405 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1089/2183] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:12:51.601118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:51.601660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:51.601660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:51.630925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:51.630925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:51.637284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1095/2184] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:51.652932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:51.674368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbfac-6b59-4ffc-8207-07cd9c857a63 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:51.683339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:51.684194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:51.684617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:51.685027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:51.697408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:51.699348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:51.709393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1090/2185] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:12:55.627422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:55.628944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:55.739381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac97fd-4023-4112-871e-8297b999b3eb None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:55.749444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:55.750377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:55.750662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:55.750972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] PATH_INFO: `/v3/users/b94ebcf38d1c4183bfc515a28152dbd5` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:55.752294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94ebcf38d1c4183bfc515a28152dbd5)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:55.754509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:55.759277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:55.957621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94ebcf38d1c4183bfc515a28152dbd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:55.958592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94ebcf38d1c4183bfc515a28152dbd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:55.959385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94ebcf38d1c4183bfc515a28152dbd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:55.978229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94ebcf38d1c4183bfc515a28152dbd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.079727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-f80cbb20-cac7-45dd-94f8-c15f6b3a96bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94ebcf38d1c4183bfc515a28152dbd5'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.097668 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1096/2186] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:55 2022] DELETE /identity/v3/users/b94ebcf38d1c4183bfc515a28152dbd5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:56.403314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:56.426964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a6e-2f60-4234-bdb5-cc4f8c253d02 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:56.501160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:56.531463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:56.536665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.536665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.536665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] PATH_INFO: `/v3/projects/badc8a1baed6416da0ecc280b07a4c44` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.536665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] RBAC: Authorizing `identity:delete_project(project_id=badc8a1baed6416da0ecc280b07a4c44)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:56.536665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:56.674699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badc8a1baed6416da0ecc280b07a4c44', 'request_id': 'req-4d5ccd22-4bba-4020-aad1-a328780e349a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.681549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badc8a1baed6416da0ecc280b07a4c44', 'request_id': 'req-4d5ccd22-4bba-4020-aad1-a328780e349a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.689933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badc8a1baed6416da0ecc280b07a4c44', 'request_id': 'req-4d5ccd22-4bba-4020-aad1-a328780e349a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.777445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] The token cache is being invalidate because project badc8a1baed6416da0ecc280b07a4c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:56.777828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.778731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:56.781537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1091/2187] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:56 2022] DELETE /identity/v3/projects/badc8a1baed6416da0ecc280b07a4c44 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:56.787461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fdc4-b9d9-4450-ac19-9c785e56089c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.787946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fdc4-b9d9-4450-ac19-9c785e56089c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.788121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fdc4-b9d9-4450-ac19-9c785e56089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.819060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6c82fdc4-b9d9-4450-ac19-9c785e56089c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:56.820359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6c82fdc4-b9d9-4450-ac19-9c785e56089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:56.837552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:56.839097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:56.902292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1097/2188] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:56.911486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.912101 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.912670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.940329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:56.941433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:56.942413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ccd22-4bba-4020-aad1-a328780e349a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:56.947854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:56.948933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:56.949222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:56.949555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] PATH_INFO: `/v3/users/cd85cd2a8250456699fdc7a5abfc7e62` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:56.951039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd85cd2a8250456699fdc7a5abfc7e62)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:56.954855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:56.979201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1098/2189] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:56.979201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:56.988201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e8a9b-9f0b-4b78-a585-013bf424dbc9 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:56.998322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.000640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.000999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.001350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.002199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:12:57.002578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.004503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.029631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1099/2190] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:12:57.030626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.042984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce080c2-3bb4-420f-b77d-342297e615a3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.050331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.051056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.053935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.053935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.053935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.054439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.156945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1100/2191] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:12:57 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:57.161717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.206235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd85cd2a8250456699fdc7a5abfc7e62'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.208278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd85cd2a8250456699fdc7a5abfc7e62'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.221795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd85cd2a8250456699fdc7a5abfc7e62'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.241516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd85cd2a8250456699fdc7a5abfc7e62'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.246910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:57.255186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:57.285020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa83b2-676d-47b2-8238-fc6951400d8c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.292239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.292937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.293218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.293499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.294208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.297527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.354144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b48f417d-9c36-445c-832d-8082b67c7683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd85cd2a8250456699fdc7a5abfc7e62'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:57.365148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1092/2192] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:56 2022] DELETE /identity/v3/users/cd85cd2a8250456699fdc7a5abfc7e62 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:57.370343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.370631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.370954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.397875 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1101/2193] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:12:57 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:12:57.398900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:57.399134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.400303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:57.401388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:57.422599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a910c5-d9f1-44dd-9a26-4ecd13d5b305 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.506634 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1093/2194] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:57.522865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.525252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:57.583127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.583127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.583127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.583127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.583965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.587433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.618896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1102/2195] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:12:57.622084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.626953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68c6a9-5963-4c15-922d-79a689bd0455 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.633645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.634297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.634580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.634901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.652426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca60dd0-3158-4f72-9bc0-b9128c8780cc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.656848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.658399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.666460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.667307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.667591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.667939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.668912 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.670632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527b541-c6e4-4262-92d6-a69ecbd45726 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:57.700349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1094/2196] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:57.710881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1103/2197] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:12:57.720450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:57.734186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6d849-52f1-45a1-b693-ccdf423598d8 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:57.740029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:57.741049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:57.741175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:57.741519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] PATH_INFO: `/v3/projects/d5ed6f9a69664ca6ac2e3a7e92459d65/users/7210995ed0a540a39a6671d694300e34/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:57.767483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ed6f9a69664ca6ac2e3a7e92459d65, user_id=7210995ed0a540a39a6671d694300e34, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:57.770366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.197846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1095/2198] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:12:57 2022] PUT /identity/v3/projects/d5ed6f9a69664ca6ac2e3a7e92459d65/users/7210995ed0a540a39a6671d694300e34/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:58.207890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.208442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.208442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.253466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] MFA Rules not processed for user `7210995ed0a540a39a6671d694300e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:58.253466 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.344100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1104/2199] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:12:58.356899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.360895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.461675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b418448-04f7-4401-b13e-10dc32e65bc8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.465937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.466687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.467118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.467419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.485004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.486461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.518425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.519018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1096/2200] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:58.520637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:58.551655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:58.586956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:58.613137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:12:58.636061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4986c5-4c00-4050-a6cd-00df88895577 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.641721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.642372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.642781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.643190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] PATH_INFO: `/v3/projects/798c7c16989541ef85a607b1092d2e31` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.644610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798c7c16989541ef85a607b1092d2e31)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.646631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.672401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9af6-55d7-4be8-b7b4-989041f439a3 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:58.679500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:58.684063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:58.684063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:58.684063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] PATH_INFO: `/v3/users/7210995ed0a540a39a6671d694300e34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:58.691151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7210995ed0a540a39a6671d694300e34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:58.693475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:58.792337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798c7c16989541ef85a607b1092d2e31', 'request_id': 'req-6fd083ae-d83b-460e-a055-782d1d3af1a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.801587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798c7c16989541ef85a607b1092d2e31', 'request_id': 'req-6fd083ae-d83b-460e-a055-782d1d3af1a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.890637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798c7c16989541ef85a607b1092d2e31', 'request_id': 'req-6fd083ae-d83b-460e-a055-782d1d3af1a3'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.907435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7210995ed0a540a39a6671d694300e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.908234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7210995ed0a540a39a6671d694300e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.911723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] The token cache is being invalidate because project 798c7c16989541ef85a607b1092d2e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:12:58.912228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.913134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6fd083ae-d83b-460e-a055-782d1d3af1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.914994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1105/2201] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:58 2022] DELETE /identity/v3/projects/798c7c16989541ef85a607b1092d2e31 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:12:58.917161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7210995ed0a540a39a6671d694300e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:58.934378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7210995ed0a540a39a6671d694300e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:59.161345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7210995ed0a540a39a6671d694300e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:12:59.167880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1097/2202] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:12:58 2022] DELETE /identity/v3/users/7210995ed0a540a39a6671d694300e34 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:12:59.174249 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.174529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.174824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.193792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:12:59.195436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.267505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1106/2203] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:12:59.279480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.281647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.366920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e1289-a12e-4af7-8eae-d28db7435094 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.373601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.375166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.375629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.381490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.412377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.414448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc035e-6246-414b-af61-82138af9e2a6 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:12:59.427750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1098/2204] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:12:59.915494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:12:59.917804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:12:59.931564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83ff2-3a6c-4391-b7d6-ec8196f08e7f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:12:59.937382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:12:59.938061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:12:59.938503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:12:59.938890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] PATH_INFO: `/v3/projects/d5ed6f9a69664ca6ac2e3a7e92459d65` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:12:59.940090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ed6f9a69664ca6ac2e3a7e92459d65)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:12:59.942171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.089205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ed6f9a69664ca6ac2e3a7e92459d65', 'request_id': 'req-8687fbf4-fe60-4541-a566-fcfb350f5ca7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:00.096879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ed6f9a69664ca6ac2e3a7e92459d65', 'request_id': 'req-8687fbf4-fe60-4541-a566-fcfb350f5ca7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:00.215858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ed6f9a69664ca6ac2e3a7e92459d65', 'request_id': 'req-8687fbf4-fe60-4541-a566-fcfb350f5ca7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:00.223846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:00.228795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] The token cache is being invalidate because project d5ed6f9a69664ca6ac2e3a7e92459d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:00.229094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:00.229746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8687fbf4-fe60-4541-a566-fcfb350f5ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:00.231377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1107/2205] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:12:59 2022] DELETE /identity/v3/projects/d5ed6f9a69664ca6ac2e3a7e92459d65 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:13:00.243302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.243786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.243884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.266542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:00.267864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:00.303582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:00.330198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1099/2206] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:00.337907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.338386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.338494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.357813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:00.359797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:00.367748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1108/2207] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:00.371938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.382084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402a97e-75fd-41d1-82b5-2a7b6452d33a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.386567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.387199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.387477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.387746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.388430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:13:00.388727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.390687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.403117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1100/2208] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:13:00.407047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.416593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cdc83-d85d-4a80-8520-cf7ea5d7d595 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.421850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.422458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.422764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.423045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.423709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.425619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.527190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1109/2209] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:13:00 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:13:00.528352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.541279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce0466-4602-468a-96d2-fa9e0c432871 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.612544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.612544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.612544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.612544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.613020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.614106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.693316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1101/2210] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:13:00 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:00.697724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.709154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a473-8314-4120-ad3a-ee7767f63050 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.713777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.714370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.714648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.714949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.715639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.718071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.729049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1110/2211] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:13:00.733695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.743853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c394a1-db45-452f-8041-da24ebb63b39 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.748503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.749160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.749441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.749719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.750413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.752047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb556c9-339c-4212-831c-527a2328df8a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.762439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1102/2212] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:00.766627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.776807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417cbd4-fd07-4553-b8e7-606048f59e57 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:00.782139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:00.784698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.784698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.784698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] PATH_INFO: `/v3/projects/823e22ba496a4d32a81e76b8e1ea1b80/users/baab4a9af32b4454b5d8503bafba8911/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.799235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=823e22ba496a4d32a81e76b8e1ea1b80, user_id=baab4a9af32b4454b5d8503bafba8911, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:00.801926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:00.896575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1111/2213] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:00 2022] PUT /identity/v3/projects/823e22ba496a4d32a81e76b8e1ea1b80/users/baab4a9af32b4454b5d8503bafba8911/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:00.901855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7b7f-1ef8-4447-b711-650f97c366e6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:00.902168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7b7f-1ef8-4447-b711-650f97c366e6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:00.902437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc7b7f-1ef8-4447-b711-650f97c366e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:00.922413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ffdc7b7f-1ef8-4447-b711-650f97c366e6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:00.923673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ffdc7b7f-1ef8-4447-b711-650f97c366e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:00.983724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1103/2214] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:00.993620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:00.995368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:01.054294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6a4e5-ec07-414d-900d-2b99ccaca7ea admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:01.057907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:01.058696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:01.059006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:01.059277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:01.069503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:01.070973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:01.081884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1112/2215] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:02.521028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebff2-8b53-406d-8a55-b0d8abb156d4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:02.521550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebff2-8b53-406d-8a55-b0d8abb156d4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:02.521550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebff2-8b53-406d-8a55-b0d8abb156d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:02.554225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a02ebff2-8b53-406d-8a55-b0d8abb156d4 None None] MFA Rules not processed for user `baab4a9af32b4454b5d8503bafba8911`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:02.555509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a02ebff2-8b53-406d-8a55-b0d8abb156d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:02.590435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:02.623798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1104/2216] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:02.635202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:02.636693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:02.694124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90978d0-4725-4796-9363-16cb32af4ddb service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:02.698562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:02.699223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:02.699503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:02.699777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:02.710679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:02.712214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:02.723571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1113/2217] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:04.564546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5db7-e6ff-4560-8108-9623175f919e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:04.564993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5db7-e6ff-4560-8108-9623175f919e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:04.565338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5db7-e6ff-4560-8108-9623175f919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:04.587769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-176c5db7-e6ff-4560-8108-9623175f919e None None] MFA Rules not processed for user `baab4a9af32b4454b5d8503bafba8911`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:04.589082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-176c5db7-e6ff-4560-8108-9623175f919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:04.597356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1105/2218] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:05.266076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:05.273640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:05.302578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c29e3-6f1a-42fc-bca3-02b9493ce5bb service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:05.323806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:05.324446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:05.324729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:05.325004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] PATH_INFO: `/v3/users/0773a59520ff4f3fba7001517251c066` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:05.327490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0773a59520ff4f3fba7001517251c066)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:05.331401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:05.600566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:05.610631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0773a59520ff4f3fba7001517251c066'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:05.611847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0773a59520ff4f3fba7001517251c066'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:05.612526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0773a59520ff4f3fba7001517251c066'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:05.625833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0773a59520ff4f3fba7001517251c066'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:05.696960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0773a59520ff4f3fba7001517251c066'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:05.716547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1114/2219] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:05 2022] DELETE /identity/v3/users/0773a59520ff4f3fba7001517251c066 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:05.722058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:05.722526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:05.722748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:05.750940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:05.754819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:05.826290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1106/2220] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:05.837129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:05.838522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:05.901415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25b2c2-4f11-48df-986e-996ca766aeb3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:05.905795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:05.906485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:05.906786 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:05.907056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:05.916828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:05.918333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6233b-b08c-4274-be99-4caf1d3cc527 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:05.929462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1115/2221] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:06.354830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:06.356283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:06.369619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b3ab2-c871-4618-aeca-9954d3c46853 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:06.375183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:06.377798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:06.377798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:06.377798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] PATH_INFO: `/v3/projects/da5d7fa560f84b149f3adb68832ea8f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:06.377798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5d7fa560f84b149f3adb68832ea8f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:06.379850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:06.514980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5d7fa560f84b149f3adb68832ea8f9', 'request_id': 'req-776c557b-79f1-46ff-8678-9bc5cb463bb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:06.522906 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5d7fa560f84b149f3adb68832ea8f9', 'request_id': 'req-776c557b-79f1-46ff-8678-9bc5cb463bb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:06.529577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5d7fa560f84b149f3adb68832ea8f9', 'request_id': 'req-776c557b-79f1-46ff-8678-9bc5cb463bb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:06.598313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] The token cache is being invalidate because project da5d7fa560f84b149f3adb68832ea8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:06.598605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:06.599273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-776c557b-79f1-46ff-8678-9bc5cb463bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:06.601000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1107/2222] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:06 2022] DELETE /identity/v3/projects/da5d7fa560f84b149f3adb68832ea8f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:06.607773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:06.608198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:06.608398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:06.629946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:06.631261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:06.696428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1116/2223] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:06.705419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:06.705765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:06.706046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:06.738594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:06.739756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:06.747612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1108/2224] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:06.753246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:06.763035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff6c1a-3e8f-40e6-8c08-2bf79eb6c26e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:06.768485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:06.769082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:06.769357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:06.769632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:06.770328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:13:06.770628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:06.772248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:06.787892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1117/2225] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:13:06.792203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:06.802590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3373d-698d-4aa1-8be5-b63af1f31b91 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:06.807490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:06.808100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:06.808448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:06.808726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:06.809395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:06.811814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:06.955555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1109/2226] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:13:06 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:13:06.956738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:06.968710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd6636-bf7b-4bb0-841b-2bdf32beeb28 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.010159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:07.027400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.028012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.028287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.028559 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.029209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.031803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.151453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1118/2227] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:13:06 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:13:07.152584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.163859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aae7f-2386-4dde-91fc-eb5dd94b101f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.168587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.169187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.170317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.170317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.170537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.172044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.182283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1110/2228] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:13:07.186083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.196241 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc596be-2ca8-4eab-82fd-a9584135e61a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.201281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.202441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.202749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.203078 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.203794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.205519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ba46f-49b3-4686-a3b7-a993218d99dc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.216773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1119/2229] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:13:07.221669 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.233402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661f74e-d225-42a3-a7de-d05a242fa0ff admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.238425 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.239168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.239513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.239848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] PATH_INFO: `/v3/projects/9a0dd636a9c04018a2c65364fde51f9c/users/e0560cc62eb640938c6fc1a452625ab1/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.248807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:07.256392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0dd636a9c04018a2c65364fde51f9c, user_id=e0560cc62eb640938c6fc1a452625ab1, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.259145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a270-32cc-42d3-b189-8cca4fb727de admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.337820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1111/2230] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:13:07 2022] PUT /identity/v3/projects/9a0dd636a9c04018a2c65364fde51f9c/users/e0560cc62eb640938c6fc1a452625ab1/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:07.338607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b8311-595f-4421-8b99-07c8ab524d34 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.338930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b8311-595f-4421-8b99-07c8ab524d34 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.339208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b8311-595f-4421-8b99-07c8ab524d34 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.340764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1120/2231] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 13:13:07.349325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.349944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.351450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.351740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.352216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.352890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.378213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:07.379740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.385281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] MFA Rules not processed for user `e0560cc62eb640938c6fc1a452625ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:07.386565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.460945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1121/2232] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:07.463127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1112/2233] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:07.474524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.474673 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.475957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.476068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.539042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13246e7c-3826-4a06-b49c-e0a35fb7ac24 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.543276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.543897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.544178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.544454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.553405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.554941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d428524-ce6a-4160-9559-af1db6e92de9 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.562066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81addc-7457-4afe-830b-15462e9acd9c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.564766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1122/2234] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:07.566140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.566869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.567214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.567555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.579382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.580822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41671a1e-0cec-4f67-9849-91c7c669347b service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.592959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1113/2235] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:07.789669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.790251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.790251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.791652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1123/2236] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:13:07.796381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47aa84-04c5-4175-adb9-5974ef963d90 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.796802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47aa84-04c5-4175-adb9-5974ef963d90 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.796963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47aa84-04c5-4175-adb9-5974ef963d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.816212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ef47aa84-04c5-4175-adb9-5974ef963d90 None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:07.817406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ef47aa84-04c5-4175-adb9-5974ef963d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.872109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1114/2237] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:07.884309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:07.885802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:07.900364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaf05d-3e8e-4ca8-9dfb-3d8795121b23 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:07.903965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:07.904576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:07.904856 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:07.905874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:07.913799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:07.915277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba445a-df6a-4bf0-b6a6-d5626bc994c9 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:07.925868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1124/2238] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:08.030766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3219-a9fc-4e6f-bd6d-de0b9b95077a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:08.030766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3219-a9fc-4e6f-bd6d-de0b9b95077a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:08.030766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3219-a9fc-4e6f-bd6d-de0b9b95077a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:08.030766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1115/2239] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:13:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:13:08.035126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:08.035410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:08.035685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:08.056582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:08.057802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:08.068308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1125/2240] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:08.079622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3219-a9fc-4e6f-bd6d-de0b9b95077a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:08.090329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3219-a9fc-4e6f-bd6d-de0b9b95077a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:08.094016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:08.094620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:08.094936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:08.095223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:08.103315 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:08.105640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:08.107116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f559677-03c8-4a4b-ac66-9d0da8d57d52 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:08.118022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1116/2241] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:12.032454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:12.072935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:12.102787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea1ddc-b4da-45a7-9df3-868881a8e0a0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:12.102787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:12.102787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:12.102787 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:12.103159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] PATH_INFO: `/v3/users/e0560cc62eb640938c6fc1a452625ab1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:12.104198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0560cc62eb640938c6fc1a452625ab1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:12.106125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:12.274778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0560cc62eb640938c6fc1a452625ab1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:12.275354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0560cc62eb640938c6fc1a452625ab1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:12.275957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0560cc62eb640938c6fc1a452625ab1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:12.288182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0560cc62eb640938c6fc1a452625ab1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:12.341303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0560cc62eb640938c6fc1a452625ab1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:12.353720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1126/2242] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:13:12 2022] DELETE /identity/v3/users/e0560cc62eb640938c6fc1a452625ab1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:12.359133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:12.359631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:12.359727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:12.379879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:12.381086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:12.441907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1117/2243] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:12.451577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:12.453160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:12.511235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf6260-a974-4a31-ad2d-f70aacce889c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:12.516017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:12.516643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:12.516913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:12.517184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:12.526937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:12.528311 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d26f8-bf97-4304-bb61-b45d592b0237 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:12.538390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1127/2244] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:13:13.029434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:13.031161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.043384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95e38-d729-498a-815c-973e82343bc7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:13.049211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:13.049871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.050149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.050426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] PATH_INFO: `/v3/projects/9a0dd636a9c04018a2c65364fde51f9c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.051755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0dd636a9c04018a2c65364fde51f9c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:13.053557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:13.061011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.061011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.061011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.081226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:13.083487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.137816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1128/2245] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:13:13.150091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:13.151483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.156302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:13.166165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0dd636a9c04018a2c65364fde51f9c', 'request_id': 'req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.173290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0dd636a9c04018a2c65364fde51f9c', 'request_id': 'req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.181103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0dd636a9c04018a2c65364fde51f9c', 'request_id': 'req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.221928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f41f6-f896-4d63-8ff0-b623d38d7390 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:13.255270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] The token cache is being invalidate because project 9a0dd636a9c04018a2c65364fde51f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:13:13.255564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.257083 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:13:13.267853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1118/2246] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:13:13 2022] DELETE /identity/v3/projects/9a0dd636a9c04018a2c65364fde51f9c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:13:13.288732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:13.289276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:13.289554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:13.289827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:13.291779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:13.371106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:13.373067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed2126-fcd2-4ef9-8627-06b4a1c0f07f service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:13.383874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1129/2247] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:13:23.250727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:23.380685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=79 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:30.688891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:30.688891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:30.776264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d8f1-cdfd-4b88-ba6f-609ea78c472b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:30.782958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:30.783587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:30.784012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:30.784319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:30.786173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:30.799509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:30.801154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:30.813146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1119/2248] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:13:35.205002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad714-0efe-4b64-ae61-5a4e13600833 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:35.205477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad714-0efe-4b64-ae61-5a4e13600833 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:35.205585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ad714-0efe-4b64-ae61-5a4e13600833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:35.228458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1f7ad714-0efe-4b64-ae61-5a4e13600833 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:35.229651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1f7ad714-0efe-4b64-ae61-5a4e13600833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:35.240397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1130/2249] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:35.263562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:35.265014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:35.279317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a608-8f26-484e-912d-cd3282b22433 service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:35.285032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:35.285638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:35.285914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:35.286184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:35.295278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:35.297487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a7964-612d-4e23-9d83-154f55a94470 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:35.307439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1120/2250] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:13:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:13:45.222585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:45.303530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=38 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:13:46.986091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:46.987202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:46.987531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:47.014990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] MFA Rules not processed for user `596ac3649c7e46bdb494635c416c9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:47.016257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:47.074024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1131/2251] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:51.516949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc047-f31e-4177-8871-3e8d75091df3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:51.517534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc047-f31e-4177-8871-3e8d75091df3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:51.517534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fc047-f31e-4177-8871-3e8d75091df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:51.540236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cf3fc047-f31e-4177-8871-3e8d75091df3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:51.541674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cf3fc047-f31e-4177-8871-3e8d75091df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:51.614291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1121/2252] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:51.703135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:51.704640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:51.791555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab774a-faee-4b53-9119-99380b477b1e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:51.797584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:51.798213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:51.798498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:51.798828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:51.808809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:51.810490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:51.825204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1132/2253] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:13:56.818397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabe4-9105-46db-87cd-8970799ea367 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:56.819415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabe4-9105-46db-87cd-8970799ea367 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:56.819707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaabe4-9105-46db-87cd-8970799ea367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:56.842549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3abaabe4-9105-46db-87cd-8970799ea367 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:13:56.844413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3abaabe4-9105-46db-87cd-8970799ea367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:13:56.855330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1122/2254] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:13:56.949854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:13:56.962774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389728e6-3cb3-4b3f-90a6-1367f3750146 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:13:56.969157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:13:56.971430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:13:56.971430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:13:56.971430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:13:56.979609 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:13:56.981460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:13:56.992396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1133/2255] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:02.354652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d837-1929-4493-9964-0691419fb768 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:02.355242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d837-1929-4493-9964-0691419fb768 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:02.355242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d837-1929-4493-9964-0691419fb768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:02.374929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f545d837-1929-4493-9964-0691419fb768 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:02.376125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f545d837-1929-4493-9964-0691419fb768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:02.384824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1123/2256] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:02.410191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:02.412059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:02.427011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac0ef8-d107-47f1-a0cd-cc245f2097a2 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:02.432403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:02.432999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:02.433278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:02.433549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:02.442185 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:02.443784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:02.453102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1134/2257] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:06.204216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a814-1b7f-40d2-89d2-ec3356c45440 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:06.204703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a814-1b7f-40d2-89d2-ec3356c45440 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:06.204818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160a814-1b7f-40d2-89d2-ec3356c45440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:06.224419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6160a814-1b7f-40d2-89d2-ec3356c45440 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:06.225617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6160a814-1b7f-40d2-89d2-ec3356c45440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:06.233465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1124/2258] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:06.270351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:06.285457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c6614-c623-4d18-a8d2-7e6600bad501 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:06.292075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:06.292749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:06.293030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:06.293308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:06.301982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:06.304388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:06.314835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1135/2259] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:10.433429 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815516f-ba66-4f73-a878-b32e21344d20 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:10.433910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815516f-ba66-4f73-a878-b32e21344d20 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:10.433910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815516f-ba66-4f73-a878-b32e21344d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:10.453949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0815516f-ba66-4f73-a878-b32e21344d20 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:10.455184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0815516f-ba66-4f73-a878-b32e21344d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:10.463231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1125/2260] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:10.494094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:10.504964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5f8f-9e3e-44a1-aff0-34402c3044e3 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:10.511654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:10.512265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:10.512550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:10.512826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:10.520960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:10.522943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:10.532169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1136/2261] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:13.695732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e70d1-541b-44f4-8f6c-0924723b082c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:13.696243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e70d1-541b-44f4-8f6c-0924723b082c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:13.696348 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e70d1-541b-44f4-8f6c-0924723b082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:13.719331 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-615e70d1-541b-44f4-8f6c-0924723b082c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:13.720399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-615e70d1-541b-44f4-8f6c-0924723b082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:13.728978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1126/2262] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:13.750494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:13.762448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a183-5406-454e-981c-ab7b935648b4 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:13.768042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:13.768669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:13.768949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:13.769222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:13.777879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:13.779494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0175138-05ca-4cc6-a1ec-d20f9064f4e2 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:13.788975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1137/2263] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:14:19.618962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449095-e9b2-4833-a334-c386c16aafcf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:19.619487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449095-e9b2-4833-a334-c386c16aafcf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:19.619487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9449095-e9b2-4833-a334-c386c16aafcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:19.627709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=43 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:19.640949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d9449095-e9b2-4833-a334-c386c16aafcf None None] MFA Rules not processed for user `4e10b618c9d349b1835c80cf30f170cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:19.643820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d9449095-e9b2-4833-a334-c386c16aafcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:19.711177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1127/2264] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:23.784532 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:29.704883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=24 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:36.772620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bbbf-4cca-46af-afe9-a428f63c662e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:36.773161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bbbf-4cca-46af-afe9-a428f63c662e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:36.773161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96bbbf-4cca-46af-afe9-a428f63c662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:36.792941 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5b96bbbf-4cca-46af-afe9-a428f63c662e None None] MFA Rules not processed for user `baab4a9af32b4454b5d8503bafba8911`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:36.794135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5b96bbbf-4cca-46af-afe9-a428f63c662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:36.850611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1138/2265] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:37.138013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da154f-09b3-4661-be02-812003f761e7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:37.138485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da154f-09b3-4661-be02-812003f761e7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:37.138657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da154f-09b3-4661-be02-812003f761e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:37.161242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-35da154f-09b3-4661-be02-812003f761e7 None None] MFA Rules not processed for user `bc8e587cb33a47c7921466f65933401c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:37.162686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-35da154f-09b3-4661-be02-812003f761e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:37.228489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1128/2266] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:46.843399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=25 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:47.219883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=25 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:14:53.515680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:53.518796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:53.518796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:53.535823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] MFA Rules not processed for user `f4b040ee36d744459ad2c8cf2a04d622`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:53.537037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:53.591916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1139/2267] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:56.294449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5931b6-7924-4656-903d-01da8b37f218 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:56.294932 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5931b6-7924-4656-903d-01da8b37f218 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:56.295054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5931b6-7924-4656-903d-01da8b37f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:56.316587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4d5931b6-7924-4656-903d-01da8b37f218 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:14:56.317797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4d5931b6-7924-4656-903d-01da8b37f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:14:56.326915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1129/2268] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:14:56.362320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:14:56.375704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174493-859b-4436-a3b1-642f5fc92712 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:14:56.381469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:14:56.382084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:14:56.382363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:14:56.382633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:14:56.391870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:14:56.393440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:14:56.403890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1140/2269] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:00.757675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e26b5-cc8a-45c1-80b0-bede0f4c61c4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:00.758252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e26b5-cc8a-45c1-80b0-bede0f4c61c4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:00.758480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e26b5-cc8a-45c1-80b0-bede0f4c61c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:00.780362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e18e26b5-cc8a-45c1-80b0-bede0f4c61c4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:00.781567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e18e26b5-cc8a-45c1-80b0-bede0f4c61c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:00.789462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1130/2270] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:00.810609 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:00.821741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09342a-4668-41ac-964c-40b938ed47f4 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:00.827723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:00.828379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:00.828664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:00.828942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:00.837923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:00.839594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:00.851459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1141/2271] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:04.696165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cb12-3279-4e69-a737-be35cefee004 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:04.697338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cb12-3279-4e69-a737-be35cefee004 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:04.697338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318cb12-3279-4e69-a737-be35cefee004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:04.717843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4318cb12-3279-4e69-a737-be35cefee004 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:04.719093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4318cb12-3279-4e69-a737-be35cefee004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:04.727202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1131/2272] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:04.749916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:04.761744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a49b1-bf96-428d-b0d1-30c11fb7e4a6 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:04.767876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:04.768489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:04.768772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:04.769048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:04.777891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:04.779523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:04.789281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1142/2273] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:10.021515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c66e-099e-4f90-990a-4d03c78c09fe None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:10.022788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c66e-099e-4f90-990a-4d03c78c09fe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:10.023611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c66e-099e-4f90-990a-4d03c78c09fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:10.045706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d753c66e-099e-4f90-990a-4d03c78c09fe None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:10.046996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d753c66e-099e-4f90-990a-4d03c78c09fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:10.054764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1132/2274] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:10.076624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:10.090012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1c31-8f65-4b87-9ccc-9a3382405a25 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:10.096524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:10.097333 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:10.097792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:10.098236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:10.108831 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:10.110460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc01bce-77d7-4ce7-9876-49a58754cabf service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:10.121207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1143/2275] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:11.673185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:11.673667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:11.673766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:11.693728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] MFA Rules not processed for user `596ac3649c7e46bdb494635c416c9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:11.694891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:11.703612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1133/2276] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:17.427812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:17.428295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:17.428490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:17.437271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=50 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:17.449622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:17.451282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:17.459171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1144/2277] 10.222.0.74 () {58 vars in 1016 bytes} [Wed Aug 3 13:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:17.503398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:17.511229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=16 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:17.517938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463501d7-cfca-4972-8ffe-4fdde6cd0081 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:17.524377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:17.525182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:17.525614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:17.526054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:17.537891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:17.540072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:17.558930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1134/2278] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:27.596936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:27.683143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:29.680159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:29.681718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:29.738119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d940370-89a2-4ec8-9650-2a56af183997 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:29.741653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:29.742261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:29.742539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:29.742849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:29.744592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:29.758149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:29.759589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:29.770825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1145/2279] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:32.116321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:32.117642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:32.132956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad522a-4419-4360-b90a-4948feadc591 service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:32.137830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:32.137830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:32.137830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:32.137830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:32.139560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:32.155571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:32.157146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:32.169859 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1135/2280] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:39.765476 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=26 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:40.818964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:40.827815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79933a50-787b-49fe-8573-b65af8664bcb service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:40.831672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:40.832279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:40.832557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:40.832854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:40.834742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:40.846737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:40.848181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:40.857614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1146/2281] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:42.163303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:44.261170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:44.263367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:44.328641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965d322-6e39-438b-a102-00017b6a7a6f service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:44.332965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:44.333625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:44.333938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:44.334220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:44.336202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:44.347808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:44.349261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:44.361974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1136/2282] 10.222.0.67 () {60 vars in 1396 bytes} [Wed Aug 3 13:15:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:44.595747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:44.597286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:44.612137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77146fd-7ce0-4c76-8f20-360e100c3779 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:44.617570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:44.618272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:44.618552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:44.618863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] PATH_INFO: `/v3/users/4e10b618c9d349b1835c80cf30f170cd` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:44.629571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e10b618c9d349b1835c80cf30f170cd)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:44.629571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:44.869876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e10b618c9d349b1835c80cf30f170cd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:44.870535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e10b618c9d349b1835c80cf30f170cd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:44.871320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e10b618c9d349b1835c80cf30f170cd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:44.883693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e10b618c9d349b1835c80cf30f170cd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:44.970265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-db647e3c-c216-44bb-a43a-5e7edad68e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e10b618c9d349b1835c80cf30f170cd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:44.983217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1147/2283] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:44 2022] DELETE /identity/v3/users/4e10b618c9d349b1835c80cf30f170cd => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:45.252856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:45.273119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe1b3e-adbb-4660-920e-a73e9a1d6743 service glance] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:45.325993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:45.326674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.327010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.327290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] PATH_INFO: `/v3/projects/62ce22d09a6648989c0eb2c79c71f8d9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.328630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ce22d09a6648989c0eb2c79c71f8d9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:45.330763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:45.440789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ce22d09a6648989c0eb2c79c71f8d9', 'request_id': 'req-d0e20960-df88-4d68-82b0-cb306d4a2942'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:45.450011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ce22d09a6648989c0eb2c79c71f8d9', 'request_id': 'req-d0e20960-df88-4d68-82b0-cb306d4a2942'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:45.457511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ce22d09a6648989c0eb2c79c71f8d9', 'request_id': 'req-d0e20960-df88-4d68-82b0-cb306d4a2942'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:45.527761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] The token cache is being invalidate because project 62ce22d09a6648989c0eb2c79c71f8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:45.528053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:45.528676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d0e20960-df88-4d68-82b0-cb306d4a2942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:45.530221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1137/2284] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:45 2022] DELETE /identity/v3/projects/62ce22d09a6648989c0eb2c79c71f8d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:45.540060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.540349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.540630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.568065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:45.569315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:45.653487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1148/2285] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:45.661712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.662038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.662540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.691892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:45.693107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:45.702491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1138/2286] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:15:45.706191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:45.722089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc89eb5-fc14-4be3-89c5-36f51b1443aa None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:45.727011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:45.727663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.728760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.728760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.728951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:15:45.729393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:45.731036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:45.745234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1149/2287] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:15:45.749854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:45.759748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7f123-adce-4825-8646-ed3035529f0a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:45.764858 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:45.765488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.765778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.766070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.766746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:45.768739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:45.858065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1139/2288] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:15:45 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:45.862325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:45.872930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95868-3632-41fb-9bc8-004f69c257e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:45.926439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:45.941462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:45.942119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:45.942401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:45.942687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:45.943386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:45.945340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:46.069276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1150/2289] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:15:45 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:46.073711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:46.081876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:46.085949 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100a0c0-5cb0-4363-a87e-a7b193c3a186 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:46.091871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:46.094256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:46.094567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:46.094874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:46.096635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:46.099266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:46.111432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1140/2290] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:46.118423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:46.129637 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca49b-d488-4866-92c2-a59a45cc7da5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:46.135048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:46.136273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:46.136273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:46.136273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:46.136883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:46.138554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3b8b4-131e-4330-86ce-d3a29e2d8eff admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:46.152165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1151/2291] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:46.159082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:46.174034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550725fa-d884-4e36-b8d1-7a24f108c325 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:46.179390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:46.180384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:46.180844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:46.181302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] PATH_INFO: `/v3/projects/fe51f15c957848209bb9f80c2717c916/users/8a5b0a75d8b84d258bff8042982688bf/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:46.201329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe51f15c957848209bb9f80c2717c916, user_id=8a5b0a75d8b84d258bff8042982688bf, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:46.205718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:46.303325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1141/2292] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:46 2022] PUT /identity/v3/projects/fe51f15c957848209bb9f80c2717c916/users/8a5b0a75d8b84d258bff8042982688bf/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:46.314999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:46.315282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:46.315557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:46.353009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] MFA Rules not processed for user `8a5b0a75d8b84d258bff8042982688bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:46.354307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:46.418664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1152/2293] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:46.430410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:46.431969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:46.513645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6768088-764b-4bce-bbab-12dacf5203f3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:46.520051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:46.520680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:46.520961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:46.521303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:46.529698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:46.531550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c50b7-1cd8-4285-983e-75ca8211a9d9 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:46.540426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1142/2294] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:52.604188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:52.665003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25208fb-eddd-455b-88b6-9c8d842341d8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:52.669524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:52.670160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:52.670439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:52.670791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] PATH_INFO: `/v3/users/8a5b0a75d8b84d258bff8042982688bf` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:52.671883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5b0a75d8b84d258bff8042982688bf)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:52.673992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:52.850413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5b0a75d8b84d258bff8042982688bf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:52.851112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5b0a75d8b84d258bff8042982688bf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:52.851721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5b0a75d8b84d258bff8042982688bf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:52.858536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:52.864084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5b0a75d8b84d258bff8042982688bf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:52.953562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5b0a75d8b84d258bff8042982688bf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:52.966909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1153/2295] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:52 2022] DELETE /identity/v3/users/8a5b0a75d8b84d258bff8042982688bf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:52.971450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:52.971890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:52.972137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:52.991409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:52.992645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:53.054656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1143/2296] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:53.064618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:53.066030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:53.123768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd72d-b08b-4bf5-af2a-40c25aebdc39 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:53.128307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:53.128997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.129287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.129567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.139131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:53.141087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c99e8-f071-406e-88b8-0134c49f4347 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:53.151995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1154/2297] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:53.565713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:53.567341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:53.579457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee169e82-6bbc-4532-8598-819ed6810edb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:53.584057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:53.584697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.584978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.585254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] PATH_INFO: `/v3/projects/fe51f15c957848209bb9f80c2717c916` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.586417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe51f15c957848209bb9f80c2717c916)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:53.588411 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:53.703702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe51f15c957848209bb9f80c2717c916', 'request_id': 'req-032e8726-c0e6-4262-b3de-179eeee7b6a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:53.704854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:53.710506 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe51f15c957848209bb9f80c2717c916', 'request_id': 'req-032e8726-c0e6-4262-b3de-179eeee7b6a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:53.715946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe51f15c957848209bb9f80c2717c916', 'request_id': 'req-032e8726-c0e6-4262-b3de-179eeee7b6a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:53.802279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] The token cache is being invalidate because project fe51f15c957848209bb9f80c2717c916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:53.802570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:53.803223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-032e8726-c0e6-4262-b3de-179eeee7b6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:53.804749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1144/2298] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:53 2022] DELETE /identity/v3/projects/fe51f15c957848209bb9f80c2717c916 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:53.809627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.810076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.810188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.829837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:53.831239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:53.892342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1155/2299] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:53.900640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.900924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.901197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.921703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:53.923509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:53.931724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1145/2300] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:53.935945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:53.945675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cfb7e-502c-43a4-886f-57b2d9f69dca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:53.950248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:53.950884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.951167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.951437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.952184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:15:53.952483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:53.954082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:53.965864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1156/2301] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:15:53.970742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:53.980073 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ec14-ee61-469b-9b77-0d983089ddde None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:53.984760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:53.985928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:53.986210 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:53.986480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:53.987189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:53.989087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.059155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1146/2302] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:15:53 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:54.060294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.070520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d595c6-7af1-47b3-96ab-feac9adaf11d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.129389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.130016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.130297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.130628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.131382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.133339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.144481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:54.362452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1157/2303] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:15:54 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:15:54.363857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.374462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a3b6b-26d3-44e1-9f57-8b66f3bc0b98 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.379199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.379943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.380345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.380624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.381321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.382956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.393658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1147/2304] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:54.397972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.409253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef9c01-7c41-45ea-a1a5-e804d5b1e554 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.414314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.414970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.420665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.420665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.420665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.420665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127c34d-b76f-4bc7-b849-6e04ca0f5871 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.428741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1158/2305] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:54.432839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.449571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0154a-1e9a-45cd-84b1-2f222ead65ba admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.449571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.449571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.449571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.449997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] PATH_INFO: `/v3/projects/93af9ae49c214c6ba9fb68611a1669ff/users/18a5572bfd0b4bd7a1c1234a3de22bfa/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.465031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93af9ae49c214c6ba9fb68611a1669ff, user_id=18a5572bfd0b4bd7a1c1234a3de22bfa, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.467749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.537825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1148/2306] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:54 2022] PUT /identity/v3/projects/93af9ae49c214c6ba9fb68611a1669ff/users/18a5572bfd0b4bd7a1c1234a3de22bfa/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:54.548346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.548621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.548895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.577761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] MFA Rules not processed for user `18a5572bfd0b4bd7a1c1234a3de22bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:54.579678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:54.653329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1159/2307] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:54.659645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.733658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecf192-cac4-497d-ac2e-2bea94f8b47e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.739536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.740620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.740620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.741048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.741678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.743793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.867239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1149/2308] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:15:54 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:54.871501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.883086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a832-872c-483c-b95b-0d48830a9d06 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.912144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:54.919324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:54.951797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.952412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.952745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.952961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.953643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.955743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.980648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95697b-a9bf-45b9-ae53-0857a188b4b5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:54.985962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:54.986611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:54.986929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:54.987208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] PATH_INFO: `/v3/users/baab4a9af32b4454b5d8503bafba8911` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:54.988440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=baab4a9af32b4454b5d8503bafba8911)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:54.990362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:54.991979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:55.085347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1160/2309] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:15:54 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:55.089187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.099283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3151-a514-42e8-9653-2923da01dd00 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.103803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.104376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.104652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.104923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.105594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.107309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.121901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1161/2310] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:15:55.122934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.133793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536feaf5-25ed-4e88-81e2-b31d9dd2f5df admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.138456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.139106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.139384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.139655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] PATH_INFO: `/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7/users/ff6912e118db42bd9a578f993f910a8d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.156936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb6d4717c894cb0ad0a5787d07104d7, user_id=ff6912e118db42bd9a578f993f910a8d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.160738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.237029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baab4a9af32b4454b5d8503bafba8911'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.237731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baab4a9af32b4454b5d8503bafba8911'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.245862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baab4a9af32b4454b5d8503bafba8911'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.246999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1162/2311] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:55 2022] PUT /identity/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7/users/ff6912e118db42bd9a578f993f910a8d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:15:55.250446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.261034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baab4a9af32b4454b5d8503bafba8911'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.284811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:55.316490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baf56d-a517-4e5b-85ce-96dfed238ab2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.321192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.321808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.322085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.322356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.323083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.324669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.336410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1163/2312] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:15:55.343405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.354198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b830377-f564-40bf-9d0b-6855cca91acb admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.359133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.359822 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.360151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.361198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] PATH_INFO: `/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7/users/ff6912e118db42bd9a578f993f910a8d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.363215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb6d4717c894cb0ad0a5787d07104d7, user_id=ff6912e118db42bd9a578f993f910a8d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.365858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.368218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-720faea2-1379-42c0-92f3-b7272d0eec4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baab4a9af32b4454b5d8503bafba8911'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.374832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1150/2313] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:54 2022] DELETE /identity/v3/users/baab4a9af32b4454b5d8503bafba8911 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:15:55.380215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1164/2314] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:55 2022] PUT /identity/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7/users/ff6912e118db42bd9a578f993f910a8d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:55.391011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.391301 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.391681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.420587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] MFA Rules not processed for user `ff6912e118db42bd9a578f993f910a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:55.421841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:55.499038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1151/2315] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:55.507041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.508835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:55.569852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d630b4-1e48-4423-85d4-e89ada3b5c5b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.618499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:55.618920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.619584 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.619868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.620060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:55.620164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.631521 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.635643 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.643841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1165/2316] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:55.696600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50109d-c6dd-4e4a-8bb7-c03927c8bcee None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:55.701192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:55.701836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:55.702119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:55.702398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] PATH_INFO: `/v3/projects/823e22ba496a4d32a81e76b8e1ea1b80` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:55.703600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823e22ba496a4d32a81e76b8e1ea1b80)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:55.705577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:55.712161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:55.835221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823e22ba496a4d32a81e76b8e1ea1b80', 'request_id': 'req-0c9dd018-4cce-44cb-91ee-1e89d3053284'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.841421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823e22ba496a4d32a81e76b8e1ea1b80', 'request_id': 'req-0c9dd018-4cce-44cb-91ee-1e89d3053284'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.847809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823e22ba496a4d32a81e76b8e1ea1b80', 'request_id': 'req-0c9dd018-4cce-44cb-91ee-1e89d3053284'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.919376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] The token cache is being invalidate because project 823e22ba496a4d32a81e76b8e1ea1b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:55.919674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.920490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0c9dd018-4cce-44cb-91ee-1e89d3053284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:55.922047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1152/2317] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:55 2022] DELETE /identity/v3/projects/823e22ba496a4d32a81e76b8e1ea1b80 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:56.528739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:56.530223 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:56.544239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e07a-d699-4dd1-951f-81cf241bcf9b service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:56.600104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:56.600733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:56.601012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:56.601283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] PATH_INFO: `/v3/users/18a5572bfd0b4bd7a1c1234a3de22bfa` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:56.602427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a5572bfd0b4bd7a1c1234a3de22bfa)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:56.604363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:56.616213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:56.789344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a5572bfd0b4bd7a1c1234a3de22bfa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:56.789992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a5572bfd0b4bd7a1c1234a3de22bfa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:56.790591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a5572bfd0b4bd7a1c1234a3de22bfa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:56.802614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a5572bfd0b4bd7a1c1234a3de22bfa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:56.890213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a5572bfd0b4bd7a1c1234a3de22bfa'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:56.903495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1166/2318] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:56 2022] DELETE /identity/v3/users/18a5572bfd0b4bd7a1c1234a3de22bfa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:56.908174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:56.908727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:56.908727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:56.929245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:56.930446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:56.988991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1153/2319] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:56.998625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:57.000091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:57.058268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe7d4e-3572-41c9-ae2e-756d813a0afe admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:57.062025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:57.062633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:57.062939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:57.063212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:57.072966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:57.074452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:57.085691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1167/2320] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:15:57.535132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:57.536562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:57.550352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c171c-7732-4e2a-a22b-2879b9c40806 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:57.555287 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:57.556025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:57.556160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:57.556438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] PATH_INFO: `/v3/projects/93af9ae49c214c6ba9fb68611a1669ff` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:57.557764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93af9ae49c214c6ba9fb68611a1669ff)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:57.559577 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:57.655461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93af9ae49c214c6ba9fb68611a1669ff', 'request_id': 'req-cb415017-8dff-4634-84af-53ecd86f9b9c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:57.661850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93af9ae49c214c6ba9fb68611a1669ff', 'request_id': 'req-cb415017-8dff-4634-84af-53ecd86f9b9c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:57.667624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93af9ae49c214c6ba9fb68611a1669ff', 'request_id': 'req-cb415017-8dff-4634-84af-53ecd86f9b9c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:57.746993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] The token cache is being invalidate because project 93af9ae49c214c6ba9fb68611a1669ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:57.747279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:57.747908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:57.749412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1154/2321] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:57 2022] DELETE /identity/v3/projects/93af9ae49c214c6ba9fb68611a1669ff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:57.753949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:57.763538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50001b94-e810-4f20-90ea-d23ff54d3ecf service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:57.821482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:57.822114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:57.822396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:57.822674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] PATH_INFO: `/v3/users/ff6912e118db42bd9a578f993f910a8d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:57.823864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6912e118db42bd9a578f993f910a8d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:57.825790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:57.995334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:58.007883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6912e118db42bd9a578f993f910a8d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.008657 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6912e118db42bd9a578f993f910a8d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.009256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6912e118db42bd9a578f993f910a8d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.020886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6912e118db42bd9a578f993f910a8d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.111012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ea029929-bd76-44e9-b205-7412c14bf542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6912e118db42bd9a578f993f910a8d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.123739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1168/2322] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:15:57 2022] DELETE /identity/v3/users/ff6912e118db42bd9a578f993f910a8d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:15:58.512145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:58.513638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:58.531402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415017-8dff-4634-84af-53ecd86f9b9c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:58.546927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:58.591337 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:58.591979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:58.592262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:58.592541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] PATH_INFO: `/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:58.593699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb6d4717c894cb0ad0a5787d07104d7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:58.595767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:58.712114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb6d4717c894cb0ad0a5787d07104d7', 'request_id': 'req-faefa086-b863-4e9a-9367-c1d2770c0793'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.718233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb6d4717c894cb0ad0a5787d07104d7', 'request_id': 'req-faefa086-b863-4e9a-9367-c1d2770c0793'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.724346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb6d4717c894cb0ad0a5787d07104d7', 'request_id': 'req-faefa086-b863-4e9a-9367-c1d2770c0793'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.808329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] The token cache is being invalidate because project 1eb6d4717c894cb0ad0a5787d07104d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:15:58.808617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.809283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-faefa086-b863-4e9a-9367-c1d2770c0793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:15:58.810866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1155/2323] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:15:58 2022] DELETE /identity/v3/projects/1eb6d4717c894cb0ad0a5787d07104d7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:58.816600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:58.817083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:58.817286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:58.838133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:58.839451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:58.901557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1169/2324] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:58.909050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:58.909352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:58.909635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:58.929156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:58.930354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:58.938407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1156/2325] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:15:58.943279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:58.953067 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f226e9f-ae0f-4d9e-bd12-9b76ee683dca None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:58.958956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:58.959563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:58.959839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:58.960110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:58.960799 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:15:58.961100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:58.962697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:58.974928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1170/2326] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:15:58.979108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:58.988344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fd2db-3a02-4df0-950a-6a3326c1ed7a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:58.993014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:58.993615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:58.993896 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:58.994171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:58.994860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:58.996756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.108689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1157/2327] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:15:58 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:59.112930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.123105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d5a2-c565-4417-891d-5cd42388f670 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.180557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.181173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.181453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.181728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.182406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.184372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.253923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1171/2328] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:15:59 2022] POST /identity/v3/users => generated 279 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:59.258026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.269011 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ac771-4531-434e-8e7f-d7f7892b75fd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.273902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.274503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.274815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.275088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.275772 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.277353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.287120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1158/2329] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:59.290917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.301452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588aef8-9ecc-4994-98d4-ee8a6d04c2d7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.306075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.306675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.306985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.307288 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.307974 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.309556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399788ba-d935-4c08-8b12-2895d6fc5fc1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.320529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1172/2330] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:59.324572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.335221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ead9-fdd1-4a78-99e1-7acf4bd2d72c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.339776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.340420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.340697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.340969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] PATH_INFO: `/v3/projects/014ae1b1172740be996ea747a2b053a1/users/1cff4734612d491fb487cf63a79c74a7/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.355759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014ae1b1172740be996ea747a2b053a1, user_id=1cff4734612d491fb487cf63a79c74a7, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.358463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.453586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1159/2331] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:59 2022] PUT /identity/v3/projects/014ae1b1172740be996ea747a2b053a1/users/1cff4734612d491fb487cf63a79c74a7/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:15:59.464295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.464574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.464844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.492916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] MFA Rules not processed for user `1cff4734612d491fb487cf63a79c74a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:15:59.494128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:15:59.498019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:59.557652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1173/2332] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:15:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:15:59.562198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.609143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:15:59.624626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e208dc-360b-42c3-8907-69752aedb327 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.631963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.632631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.632857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.642356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.642356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.642356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.720317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1160/2333] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:15:59 2022] POST /identity/v3/projects => generated 355 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:59.724750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.735620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69341-58f4-43d7-8ad1-601c461c28c4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.791439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.792041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.792317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.792587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.793247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.795194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.902624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1174/2334] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:15:59 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:15:59.906639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.917364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19beb-eb9f-496e-94b5-fe407f49ce92 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.922296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.922955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.923293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.923501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.924192 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.925797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:15:59.939532 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1161/2335] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:15:59.946983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:15:59.958093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfbcf-096c-48ef-a1c8-4e74908c3a24 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:15:59.962698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:15:59.963433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:15:59.963663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:15:59.963936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] PATH_INFO: `/v3/projects/c1c958de4da84127a3792c716672b5e0/users/209dea6b631544e9b69093cac108d219/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:15:59.979227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c958de4da84127a3792c716672b5e0, user_id=209dea6b631544e9b69093cac108d219, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:15:59.981910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:00.052350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1175/2336] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:15:59 2022] PUT /identity/v3/projects/c1c958de4da84127a3792c716672b5e0/users/209dea6b631544e9b69093cac108d219/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:00.056354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:00.067006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15077-a1b2-46e8-96cd-4f8c2843fbb7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:00.126286 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:00.126940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:00.127221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:00.128241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:00.129108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:00.130763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6e72-5532-4872-91f0-067934a5f9d8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:00.141059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1162/2337] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:00.145296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:00.156115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55603-52da-49ee-ad01-197ac9691eb9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:00.161644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:00.164127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:00.164127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:00.164127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] PATH_INFO: `/v3/projects/c1c958de4da84127a3792c716672b5e0/users/209dea6b631544e9b69093cac108d219/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:00.164810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c958de4da84127a3792c716672b5e0, user_id=209dea6b631544e9b69093cac108d219, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:00.167482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:00.178431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1176/2338] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:00 2022] PUT /identity/v3/projects/c1c958de4da84127a3792c716672b5e0/users/209dea6b631544e9b69093cac108d219/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:00.189789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:00.190862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:00.190862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:00.218534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] MFA Rules not processed for user `209dea6b631544e9b69093cac108d219`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:00.219763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:00.288924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1163/2339] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:00.300683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:00.302396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:00.358054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6400fc-c4b4-4e66-8cff-554cfca2c40b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:00.361669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:00.362902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:00.363180 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:00.363451 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:00.372207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:00.373617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:00.379232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:00.384129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1177/2340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:00.630328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:00.640440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41570f24-9edc-4f9d-ac8d-d37307e3f2f9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:00.644711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:00.645323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:00.649692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:00.649692 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:00.685504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:00.707096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:00.707096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151a688-0873-4819-b221-a22f2086624f service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:00.714899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1164/2341] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:02.519065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:02.520586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:02.608409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbcd20-778b-4bf1-865d-d695358c7e97 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:02.615019 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:02.615641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:02.620096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:02.620096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:02.620096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:02.680299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:02.681907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:02.692336 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1178/2342] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:03.168346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:03.168810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:03.168997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:03.188417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:03.189616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:03.248705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1165/2343] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:16:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:03.397952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:03.399383 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:03.467620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71d14-1cd0-4da3-b7f7-b01b78650a63 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:03.472806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:03.473422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:03.473699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:03.473970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:03.482346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:03.483966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:03.493112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1179/2344] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:16:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:16:13.241746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=35 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:13.489898 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=88 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:15.031880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:15.033440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:15.096441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32da5cd-2165-44c0-a2e2-281849b4c496 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:15.100934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:15.101553 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:15.101831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:15.102105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:15.103986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:15.116125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:15.117884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:15.126274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1166/2345] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:18.150954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:18.152646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:18.169973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e722-6076-4afe-92cf-5bc9d51f2067 service swift] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:18.175569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:18.177036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:18.177319 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:18.177595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:18.179401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:18.192729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:18.194322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:18.205711 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1180/2346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:18.488119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:18.502568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed020a-7e64-45ee-ad76-a8f4718188bc service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:18.508281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:18.508900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:18.509181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:18.509456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:18.511214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:18.572510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:18.574138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534882f-ac69-46f3-9715-285f62b6df64 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:18.584536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1167/2347] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:20.863028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:20.926947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211c7c8-9c78-40b6-82cc-b6a2b773eb43 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:20.931537 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:20.932183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:20.932465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:20.932736 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] PATH_INFO: `/v3/users/1cff4734612d491fb487cf63a79c74a7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:20.933892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cff4734612d491fb487cf63a79c74a7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:20.935886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:21.133395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cff4734612d491fb487cf63a79c74a7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.134093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cff4734612d491fb487cf63a79c74a7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.134696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cff4734612d491fb487cf63a79c74a7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.147625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cff4734612d491fb487cf63a79c74a7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.213243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cff4734612d491fb487cf63a79c74a7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.225876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1181/2348] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:20 2022] DELETE /identity/v3/users/1cff4734612d491fb487cf63a79c74a7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:21.230327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:21.230805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:21.231087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:21.250039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:21.251290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:21.311198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1168/2349] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:21.321877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:21.323303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:21.387070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8d7d-00f2-441c-8e9f-e7bc800bba46 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:21.390629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:21.391298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:21.391582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:21.391858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:21.401277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:21.402700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:21.412203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1182/2350] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:21.792806 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:21.794230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:21.806757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e820fb-f305-417a-a942-6ca3e547b165 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:21.811955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:21.812153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:21.812318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:21.812585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] PATH_INFO: `/v3/projects/014ae1b1172740be996ea747a2b053a1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:21.813794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014ae1b1172740be996ea747a2b053a1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:21.815793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:21.941494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:21.950471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014ae1b1172740be996ea747a2b053a1', 'request_id': 'req-9f60b260-084f-4df6-8135-04a43086b446'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.956732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014ae1b1172740be996ea747a2b053a1', 'request_id': 'req-9f60b260-084f-4df6-8135-04a43086b446'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:21.962296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014ae1b1172740be996ea747a2b053a1', 'request_id': 'req-9f60b260-084f-4df6-8135-04a43086b446'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.103145 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] The token cache is being invalidate because project 014ae1b1172740be996ea747a2b053a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:22.103590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.104236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.106131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1169/2351] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:21 2022] DELETE /identity/v3/projects/014ae1b1172740be996ea747a2b053a1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:22.109973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:22.120473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705551-ac3c-4afe-b3d0-88ac47655d38 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:22.125911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:22.187445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:22.187978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:22.188260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:22.188660 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] PATH_INFO: `/v3/users/209dea6b631544e9b69093cac108d219` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:22.189923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=209dea6b631544e9b69093cac108d219)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:22.192036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:22.436049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209dea6b631544e9b69093cac108d219'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.436857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209dea6b631544e9b69093cac108d219'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.437611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209dea6b631544e9b69093cac108d219'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.450626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209dea6b631544e9b69093cac108d219'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.564744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209dea6b631544e9b69093cac108d219'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:22.578659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1183/2352] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:22 2022] DELETE /identity/v3/users/209dea6b631544e9b69093cac108d219 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:22.821909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:22.825531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:22.927106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b260-084f-4df6-8135-04a43086b446 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:22.994749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:22.995583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:22.995583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:22.995805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:22.997940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.012547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.016296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14a4e4-7b39-4200-b722-61c544588e58 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:23.034901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1170/2353] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:23.297328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:23.299824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.411907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f4a8c-e857-423f-b75b-6b3452b7fb5c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:23.417171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:23.417824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.418104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.418379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] PATH_INFO: `/v3/projects/c1c958de4da84127a3792c716672b5e0` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.419581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c958de4da84127a3792c716672b5e0)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.421589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:23.547312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:23.562649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c958de4da84127a3792c716672b5e0', 'request_id': 'req-1eb08804-95aa-4d85-856f-3f01394b61ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:23.571219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c958de4da84127a3792c716672b5e0', 'request_id': 'req-1eb08804-95aa-4d85-856f-3f01394b61ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:23.665089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c958de4da84127a3792c716672b5e0', 'request_id': 'req-1eb08804-95aa-4d85-856f-3f01394b61ef'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:23.678115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] The token cache is being invalidate because project c1c958de4da84127a3792c716672b5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:23.678405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:23.679120 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1eb08804-95aa-4d85-856f-3f01394b61ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:23.680671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1184/2354] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:23 2022] DELETE /identity/v3/projects/c1c958de4da84127a3792c716672b5e0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:23.685648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.686096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.686575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.708828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:23.710054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.762576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:23.773712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1171/2355] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:23.781703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.781994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.782345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.806859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:23.809399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.819210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1185/2356] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:23.823341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:23.834029 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03becd-42ee-4583-9221-ff15b5c8617f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:23.839328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:23.839965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.840281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.840486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.841182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:23.841484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.843154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:23.850654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:23.852366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.858746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1172/2357] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:23.860966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:23.873926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233d03-3042-41d4-9e40-291ccf1ba8d5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:23.879097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:23.879740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.880010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.880471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.880928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.883041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:23.940925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec63af8-c17b-45d5-8d7d-1f128611570a None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:23.947555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:23.948392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:23.948678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:23.950841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:23.960412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:23.980599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:23.983275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.014052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1186/2358] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:24.054129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1173/2359] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:23 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:24.058749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.075648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8313-54bd-46ef-b813-53c00326ffa3 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:24.189855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:24.190973 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.191304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.191576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.193041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:24.195133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.299091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1187/2360] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:24 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:24.301004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.311972 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33fed6-6ebc-4dec-92d6-ead8e2d132bb admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:24.316613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:24.317767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.318226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.318502 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.319236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:24.320840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.330761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1174/2361] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:24.335507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.345500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8400ce-2bb2-43ea-97a8-6480bc2c607e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:24.351658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:24.352273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.352551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.352823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.353515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:24.355146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0794e-330b-40df-bfd9-5506b212f811 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.369996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1188/2362] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:24.371473 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.382999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd9413-840b-4f09-b672-258565b809a3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:24.388471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:24.389215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.389557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.389899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] PATH_INFO: `/v3/projects/aa07d3e83ed84805a97098ff62c718c0/users/7f6559dee4a04525850132d30e372bdb/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.405841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa07d3e83ed84805a97098ff62c718c0, user_id=7f6559dee4a04525850132d30e372bdb, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:24.408650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.492294 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1175/2363] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:24 2022] PUT /identity/v3/projects/aa07d3e83ed84805a97098ff62c718c0/users/7f6559dee4a04525850132d30e372bdb/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:24.503888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.505167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.505751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.567838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] MFA Rules not processed for user `7f6559dee4a04525850132d30e372bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:24.569858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:24.576517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:24.649132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1189/2364] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:24.653740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.739646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228596-063b-4da2-ac72-a89700994f85 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:24.744638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:24.750279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:24.750279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:24.750279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:24.750279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:24.750279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:24.890593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1176/2365] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:24 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:24.894949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:24.907632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e22e7-c4c8-412b-840d-fb112b4750f7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.017629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.028370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.028370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.028370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.028370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.028370 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.239748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1190/2366] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:24 2022] POST /identity/v3/users => generated 297 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:25.243350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:25.313168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87d6e-ba50-4e1f-8254-a5908a088ba6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.318205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.318856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.319139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.319418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.320155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.323603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.338095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1177/2367] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:25.339282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:25.350960 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331938dc-0ed8-4e3d-8b2f-462f88a1689a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.356267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.356936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.357214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.357554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] PATH_INFO: `/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce/users/d0070942954c4c3aab4e23ea01d2dd66/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.373615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38e6172c38f4ab2a3b857f3df5464ce, user_id=d0070942954c4c3aab4e23ea01d2dd66, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.376677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.470326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1191/2368] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:25 2022] PUT /identity/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce/users/d0070942954c4c3aab4e23ea01d2dd66/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:25.475105 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:25.485336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302bad-053f-4855-9e6e-b04e15a35d36 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.497513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:25.547317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.548327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.548657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.548957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.549643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.551356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb649f-2056-458a-acdf-2179b5fe505f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.564688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1178/2369] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:25.565850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:25.579815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f28e-74f4-49f8-89e7-535f9cc70ef5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.585617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.586281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.586561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.586874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] PATH_INFO: `/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce/users/d0070942954c4c3aab4e23ea01d2dd66/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.588915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38e6172c38f4ab2a3b857f3df5464ce, user_id=d0070942954c4c3aab4e23ea01d2dd66, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.591808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.615869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1192/2370] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:25 2022] PUT /identity/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce/users/d0070942954c4c3aab4e23ea01d2dd66/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:25.627117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.627485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.627689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.665168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] MFA Rules not processed for user `d0070942954c4c3aab4e23ea01d2dd66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:25.666452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:25.756830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1179/2371] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:25.773975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:25.775740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:25.791896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:25.885208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74d276-0c25-4335-80c5-cc9f93afb00c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:25.889131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:25.891431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:25.891431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:25.891431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:25.899654 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:25.901115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febde5d-b8c7-4c0d-aa67-ab981d6a9958 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:25.910448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1193/2372] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:26.012367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:26.022549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e818b-4cb9-485b-8ad4-d0c0f41faf2f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:26.026161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:26.026809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:26.027104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:26.027361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:26.086049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:26.087529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:26.098788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1180/2373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:26.915579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:26.916496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:26.916992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:26.956698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:26.958769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:27.026377 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1194/2374] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:27.043679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:27.048762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:27.098899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:27.129763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc891c6-e6ad-4c5d-a97f-1f7e7c5cb76a service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:27.136100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:27.137088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:27.137547 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:27.137992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:27.151513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:27.153712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e909b1-280b-4c74-9666-98feb6d8e023 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:27.163176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1181/2375] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:16:29.338302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:29.437171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394f60b-2974-4a01-861f-45d6b3290a14 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:29.455450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:29.456719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:29.457351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:29.457905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] PATH_INFO: `/v3/users/7f6559dee4a04525850132d30e372bdb` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:29.460433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6559dee4a04525850132d30e372bdb)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:29.463034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:29.477420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:29.663125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6559dee4a04525850132d30e372bdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:29.663826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6559dee4a04525850132d30e372bdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:29.664462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6559dee4a04525850132d30e372bdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:29.682672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6559dee4a04525850132d30e372bdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:29.761681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6559dee4a04525850132d30e372bdb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:29.779202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1195/2376] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:29 2022] DELETE /identity/v3/users/7f6559dee4a04525850132d30e372bdb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:29.783934 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:29.784785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:29.785221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:29.816498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:29.817980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:29.922247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1182/2377] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:29.934141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:29.936251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:30.024022 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47ed10-dc50-4c38-bcc0-a6a0e8f261b6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:30.028237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:30.028896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:30.029173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:30.029446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:30.040317 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:30.042011 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:30.067271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1196/2378] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:30.763035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:30.764467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:30.786416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3bf5f-39b7-4827-a699-cdb44371baa6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:30.792726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:30.793622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:30.794091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:30.794571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] PATH_INFO: `/v3/projects/aa07d3e83ed84805a97098ff62c718c0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:30.796032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa07d3e83ed84805a97098ff62c718c0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:30.798378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:30.954821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa07d3e83ed84805a97098ff62c718c0', 'request_id': 'req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:30.964826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa07d3e83ed84805a97098ff62c718c0', 'request_id': 'req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:30.974284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa07d3e83ed84805a97098ff62c718c0', 'request_id': 'req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.055664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] The token cache is being invalidate because project aa07d3e83ed84805a97098ff62c718c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:31.055664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.055664 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.056951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1183/2379] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:30 2022] DELETE /identity/v3/projects/aa07d3e83ed84805a97098ff62c718c0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:31.060887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:31.072091 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5406-4442-45eb-9949-24345dafbbc7 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:31.155158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:31.155802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:31.156082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:31.156359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] PATH_INFO: `/v3/users/d0070942954c4c3aab4e23ea01d2dd66` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:31.157620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0070942954c4c3aab4e23ea01d2dd66)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:31.159700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:31.176771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:31.348653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0070942954c4c3aab4e23ea01d2dd66'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.349544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0070942954c4c3aab4e23ea01d2dd66'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.350234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0070942954c4c3aab4e23ea01d2dd66'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.372693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0070942954c4c3aab4e23ea01d2dd66'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.430745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0070942954c4c3aab4e23ea01d2dd66'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:31.446993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1197/2380] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:31 2022] DELETE /identity/v3/users/d0070942954c4c3aab4e23ea01d2dd66 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:31.592155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:31.593738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:31.649882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:31.660991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3db1-1d33-4089-93ce-7e7d3466e7c2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:31.730703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:31.731733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:31.732222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:31.732730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:31.734829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:31.837593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:31.839102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b26d-565b-4c66-b095-2f2fa5b1fc55 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:31.854844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1184/2381] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:32.151779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:32.156701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:32.176460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8630-2151-4aa7-8c4e-129f52d0e8a0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:32.182700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:32.184914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:32.184914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:32.184914 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] PATH_INFO: `/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:32.185651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38e6172c38f4ab2a3b857f3df5464ce)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:32.197730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:32.352681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38e6172c38f4ab2a3b857f3df5464ce', 'request_id': 'req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:32.360620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38e6172c38f4ab2a3b857f3df5464ce', 'request_id': 'req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:32.425345 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38e6172c38f4ab2a3b857f3df5464ce', 'request_id': 'req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:32.441671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] The token cache is being invalidate because project d38e6172c38f4ab2a3b857f3df5464ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:32.442575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:32.443452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ddd32ce9-9c6a-44a2-a8e7-b77dfac371af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:32.445012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1198/2382] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:32 2022] DELETE /identity/v3/projects/d38e6172c38f4ab2a3b857f3df5464ce => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:32.451685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:32.452317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:32.452841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:32.540240 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:32.544146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:32.642455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1185/2383] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:32.651297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:32.651585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:32.651877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:32.677037 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:32.678202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:32.690302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1199/2384] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:32.691464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:32.704812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a75c8-c6a1-4b86-8b4a-b7cfb509fe58 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:32.711304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:32.711938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:32.712218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:32.712492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:32.713201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:32.713504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:32.715292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:32.730044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1186/2385] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:32.734353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:32.744710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f05f02-6cb7-4373-a87d-98c68f63300f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:32.749915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:32.750780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:32.751238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:32.751662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:32.752500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:32.754813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:32.896683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1200/2386] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:32 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:32.897853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:32.911195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919b359-d771-4dfa-8daa-ced9b433306a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:32.923837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:33.001415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:33.002197 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.002509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.002894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.003640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:33.006654 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:33.104889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1187/2387] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:32 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:33.107221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:33.117704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85172c8d-3c10-42e2-b535-f3467eace9b5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:33.122395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:33.123057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.123331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.123662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.124279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:33.125872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:33.142151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1201/2388] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:33.143609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:33.181217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f9351-7d91-41f3-b7da-cce545af0e40 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:33.195716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:33.196632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.197067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.197485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.198464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:33.200285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67537ba9-8f48-4350-b662-c12e5da97524 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:33.239344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:33.248160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1188/2389] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:33.259123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995f5a-e1c9-4a2b-9754-e23cf943728d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:33.266089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:33.267511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.267958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.268391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] PATH_INFO: `/v3/projects/9f4e4cbb44004c13b55dab4ba6e2f84a/users/0c42333945ad4d4dae5a92a2c080111c/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.295926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4e4cbb44004c13b55dab4ba6e2f84a, user_id=0c42333945ad4d4dae5a92a2c080111c, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:33.298981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:33.383228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1202/2390] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:33 2022] PUT /identity/v3/projects/9f4e4cbb44004c13b55dab4ba6e2f84a/users/0c42333945ad4d4dae5a92a2c080111c/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:33.476534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.476534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.476534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.516459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] MFA Rules not processed for user `0c42333945ad4d4dae5a92a2c080111c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:33.516459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:33.669842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1189/2391] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:33.680391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:33.682155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:33.688880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:33.790469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb881db-a35d-4aeb-90f6-420dd5cbd6e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:33.795003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:33.795765 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:33.796050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:33.796329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:33.813494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:33.820257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:33.836673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1203/2392] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:37.342523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:37.344267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:37.418259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184aab3-81f3-4482-9f63-b8c1d41dee8e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:37.422977 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:37.423682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:37.423965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:37.424248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] PATH_INFO: `/v3/users/f4b040ee36d744459ad2c8cf2a04d622` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:37.425531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b040ee36d744459ad2c8cf2a04d622)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:37.428079 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:37.452196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:37.607472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b040ee36d744459ad2c8cf2a04d622'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:37.608118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b040ee36d744459ad2c8cf2a04d622'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:37.616916 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b040ee36d744459ad2c8cf2a04d622'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:37.633682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b040ee36d744459ad2c8cf2a04d622'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:37.736285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-58148d1c-b8ef-44fe-9e2f-9be66a35ea24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b040ee36d744459ad2c8cf2a04d622'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:37.744062 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1190/2393] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:37 2022] DELETE /identity/v3/users/f4b040ee36d744459ad2c8cf2a04d622 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:37.997977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.011380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43f8a0-1ae1-4394-8aab-ae018abf2006 service glance] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.082704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.083460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.083813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.084937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] PATH_INFO: `/v3/projects/2209a459f09d4830b7a776d187f07bfc` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.086448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2209a459f09d4830b7a776d187f07bfc)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.088220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.232410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2209a459f09d4830b7a776d187f07bfc', 'request_id': 'req-6cd58287-2ca0-421f-b709-0b4518ed2ae4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:38.238396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2209a459f09d4830b7a776d187f07bfc', 'request_id': 'req-6cd58287-2ca0-421f-b709-0b4518ed2ae4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:38.339161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2209a459f09d4830b7a776d187f07bfc', 'request_id': 'req-6cd58287-2ca0-421f-b709-0b4518ed2ae4'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:38.350964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] The token cache is being invalidate because project 2209a459f09d4830b7a776d187f07bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:38.351260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:38.352381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6cd58287-2ca0-421f-b709-0b4518ed2ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:38.357430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1204/2394] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:37 2022] DELETE /identity/v3/projects/2209a459f09d4830b7a776d187f07bfc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:38.359914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.360352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.360439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.385113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:38.386521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:38.464990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1191/2395] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:38.475117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.475401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.475709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.497251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:38.498483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:38.507709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1205/2396] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:38.512160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.523046 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b6b99-8a47-43b2-808c-8e4c56dfc8fc None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.528191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.528851 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.529125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.529696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.530435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:38.530801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.533948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.549677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1192/2397] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:16:38.555462 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.565608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21171153-64bb-4015-8f7c-67c6883a0596 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.570900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.573968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.573968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.573968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.573968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.574824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.724361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1206/2398] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:38 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:38.727264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.740601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1182a-a839-40b5-ae27-dd64d5f211c4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.829728 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.830347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.830625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.831087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.832748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.834402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.905262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1193/2399] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:38 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:38.909280 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.920578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea483-68af-4d96-8e75-2856c18d647d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.925659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.926550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.926865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.927144 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.927852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.929542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.930959 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:38.944142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1207/2400] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:38.945714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.955975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474069-f4a8-4e1a-a86e-5ba5ff03969a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.961314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.961913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.962199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.962504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:38.963232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:38.964838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b38db-d2bd-4176-b44b-fbb261ccb0c1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:38.976978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1194/2401] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:38.980830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:38.991728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c98b2-21a5-4931-b537-2b2828aab591 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:38.996544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:38.997201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:38.997484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:38.997760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] PATH_INFO: `/v3/projects/4a31708dac944f1db7cd3c2edfc50406/users/2d10a4521978447e97568bd56bb60747/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:39.014489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a31708dac944f1db7cd3c2edfc50406, user_id=2d10a4521978447e97568bd56bb60747, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:39.018825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:39.108123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1208/2402] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:38 2022] PUT /identity/v3/projects/4a31708dac944f1db7cd3c2edfc50406/users/2d10a4521978447e97568bd56bb60747/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:39.118322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510051ae-785d-4294-95de-f9e185edd456 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:39.118629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510051ae-785d-4294-95de-f9e185edd456 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:39.118936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510051ae-785d-4294-95de-f9e185edd456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:39.147452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:39.165730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-510051ae-785d-4294-95de-f9e185edd456 None None] MFA Rules not processed for user `2d10a4521978447e97568bd56bb60747`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:39.167067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-510051ae-785d-4294-95de-f9e185edd456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:39.241923 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1195/2403] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:39.253656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:39.256226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:39.342189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9be1f-7a61-4869-b49c-537b94938916 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:39.351680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:39.352391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:39.352899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:39.353237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:39.368464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:39.370868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f648f-ecde-4e26-b582-607739027e6f service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:39.381321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1209/2404] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:16:43.838201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510051ae-785d-4294-95de-f9e185edd456 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:43.901990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510051ae-785d-4294-95de-f9e185edd456 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:43.906510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:43.910183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:43.910183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:43.910183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] PATH_INFO: `/v3/users/2d10a4521978447e97568bd56bb60747` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:43.910183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d10a4521978447e97568bd56bb60747)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:43.911494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:44.132635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d10a4521978447e97568bd56bb60747'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:44.133307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d10a4521978447e97568bd56bb60747'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:44.140357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d10a4521978447e97568bd56bb60747'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:44.153320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d10a4521978447e97568bd56bb60747'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:44.252889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d10a4521978447e97568bd56bb60747'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:44.260157 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1196/2405] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:43 2022] DELETE /identity/v3/users/2d10a4521978447e97568bd56bb60747 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:44.264695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fda3-9146-4337-9d21-7a5eb9e8b394 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:44.265174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fda3-9146-4337-9d21-7a5eb9e8b394 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:44.265287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9fda3-9146-4337-9d21-7a5eb9e8b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:44.285987 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-96c9fda3-9146-4337-9d21-7a5eb9e8b394 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:44.287365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96c9fda3-9146-4337-9d21-7a5eb9e8b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:44.351135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1210/2406] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:44.360948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:44.362387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:44.384423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:44.424146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffee97-82cd-4623-a598-7d6853f30a8b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:44.427913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:44.428599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:44.428880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:44.429156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:44.438514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:44.441152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:44.451043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1197/2407] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:44.744220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:44.744511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:44.744884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:44.768421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:44.769600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:44.837226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1211/2408] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:44.850146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:44.851741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:44.888298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:44.890419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:44.909454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:44.922922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9370fb-f5de-4239-928c-48ab72256741 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:44.940231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:44.941627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:44.942442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:44.942739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] PATH_INFO: `/v3/projects/4a31708dac944f1db7cd3c2edfc50406` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:44.949201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a31708dac944f1db7cd3c2edfc50406)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:44.951774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:44.954109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3ddd-b9d8-4335-8f9f-012804ac7135 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:44.960660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:44.961296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:44.961755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:44.962035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:44.972167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:44.974981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b33d6-926d-4f56-83e2-c3ade6b84662 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:44.985144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1198/2409] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:16:45.079034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a31708dac944f1db7cd3c2edfc50406', 'request_id': 'req-73741c85-d2b0-4500-b572-deeb16ad09fb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:45.084485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a31708dac944f1db7cd3c2edfc50406', 'request_id': 'req-73741c85-d2b0-4500-b572-deeb16ad09fb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:45.198695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a31708dac944f1db7cd3c2edfc50406', 'request_id': 'req-73741c85-d2b0-4500-b572-deeb16ad09fb'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:45.212105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] The token cache is being invalidate because project 4a31708dac944f1db7cd3c2edfc50406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:45.212416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:45.213059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-73741c85-d2b0-4500-b572-deeb16ad09fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:45.214697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1212/2410] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:44 2022] DELETE /identity/v3/projects/4a31708dac944f1db7cd3c2edfc50406 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:45.219765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.220109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.220448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.247009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:45.248263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:45.314321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1199/2411] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:45.322364 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.322884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.322991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.343196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:45.346760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:45.353842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1213/2412] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:45.358401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.369945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768f48-58ee-4a75-9d13-d5d07f8c1c82 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.375010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.375626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.375902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.376171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.376860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:45.377159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.378791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.394398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1200/2413] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:45.401274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.413647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e523-8afb-45f7-ba27-24b60bffcc80 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.420518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.421165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.421450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.421722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.422659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.424830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.532039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1214/2414] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:45 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:45.538883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.549581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee970cf-1d71-44fd-b21d-82c733974d4d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.592783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:45.620234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.620976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.621342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.621710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.622481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.624655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.714795 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1201/2415] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:45 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:45.716086 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.728494 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7e3c3-eaf5-4409-a468-59c56aed7a3f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.733277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.733966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.734801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.734801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.735374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.737168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.751196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1215/2416] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:45.755940 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.766364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570592-07d2-421a-bb26-c118f3407e17 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.772167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.772785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.773211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.773497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.774190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.775864 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e71f63-863c-47c3-96c4-236fe19df73b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.787549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1202/2417] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:45.792354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:45.804803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0085ff-99b7-44fc-b359-25884e09e15e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:45.810246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:45.811041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.811369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.811583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] PATH_INFO: `/v3/projects/afb65fdfb4d7481cbfce17a37019589d/users/f780fa0ce1c2466ead5590b885cbf476/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.833880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb65fdfb4d7481cbfce17a37019589d, user_id=f780fa0ce1c2466ead5590b885cbf476, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:45.836597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:45.951024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1216/2418] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:45 2022] PUT /identity/v3/projects/afb65fdfb4d7481cbfce17a37019589d/users/f780fa0ce1c2466ead5590b885cbf476/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:45.968641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:45.968641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:45.968641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:45.993958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] MFA Rules not processed for user `f780fa0ce1c2466ead5590b885cbf476`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:45.995491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:46.074840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1203/2419] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:46.080128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.144430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733349c1-34fa-482e-9ddb-c2a6f6fc31e9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.150804 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.151432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.151718 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.151994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.152677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.154636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.278056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1217/2420] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:46 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:46.282159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.293087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1aac5-51ef-4595-aca3-e56ff0ce575c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.355781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.356398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.356676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.356948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.357619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.359558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.468206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1204/2421] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:46 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:46.469520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.480429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606506b1-7804-403c-a8ae-97a93ba3778d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.485194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.485738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.486020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.486293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.487080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.488620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.490009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:46.500118 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1218/2422] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:46.508675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.518767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785423-21ca-4b50-91ea-2c9c9b69beb1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.524630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.525333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.525612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.525884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] PATH_INFO: `/v3/projects/5b511973873943558684e7ec13e10e18/users/970252105a15424fa28b5a80d62e793e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.541261 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b511973873943558684e7ec13e10e18, user_id=970252105a15424fa28b5a80d62e793e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.544059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.625403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1205/2423] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:46 2022] PUT /identity/v3/projects/5b511973873943558684e7ec13e10e18/users/970252105a15424fa28b5a80d62e793e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:46.631536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.641859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c21-a7be-435c-9935-149f0639796e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.713429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.714041 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.714313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.714588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.715322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.716968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79529bc2-22ab-4246-9b43-c1c656da6be5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.727847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1219/2424] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:46.732249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.743278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710fa8-fc2b-4f85-b28e-232fe8803b67 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.748841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.749511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.749790 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.750086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] PATH_INFO: `/v3/projects/5b511973873943558684e7ec13e10e18/users/970252105a15424fa28b5a80d62e793e/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.752047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b511973873943558684e7ec13e10e18, user_id=970252105a15424fa28b5a80d62e793e, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:46.755474 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:46.758875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:46.766870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1206/2425] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:46 2022] PUT /identity/v3/projects/5b511973873943558684e7ec13e10e18/users/970252105a15424fa28b5a80d62e793e/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:46.784156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.784450 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.784833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:46.820357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] MFA Rules not processed for user `970252105a15424fa28b5a80d62e793e`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:46.822158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:46.911159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1220/2426] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:46.918455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.919956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:46.955918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:46.957479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:46.993137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cbe7-0418-4520-9798-54af34a33fc9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:46.997927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:46.998554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:46.998876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:46.999150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:47.010078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:47.011619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:47.023392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1207/2427] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:47.040472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bceed-0364-429e-a64b-dde0a573c0e7 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:47.044664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:47.045705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:47.046294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:47.046839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:47.049795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:47.091472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:47.138616 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:47.140181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5986-8047-4899-840c-86a56d1a2a50 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:47.156969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1221/2428] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:16:50.065687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:50.077163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ea1-d8cd-4976-a073-0f5c5ba9a78e service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:50.081848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:50.086408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:50.086408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:50.086408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] PATH_INFO: `/v3/users/f780fa0ce1c2466ead5590b885cbf476` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:50.086408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f780fa0ce1c2466ead5590b885cbf476)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:50.086408 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:50.310221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f780fa0ce1c2466ead5590b885cbf476'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:50.310924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f780fa0ce1c2466ead5590b885cbf476'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:50.319752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f780fa0ce1c2466ead5590b885cbf476'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:50.335908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f780fa0ce1c2466ead5590b885cbf476'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:50.450190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f780fa0ce1c2466ead5590b885cbf476'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:50.456845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1208/2429] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:50 2022] DELETE /identity/v3/users/f780fa0ce1c2466ead5590b885cbf476 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:50.462318 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:50.462789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:50.462916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:50.481977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:50.483222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:50.555671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1222/2430] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:50.565539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:50.568055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:50.645919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac9bc-a9e1-4c04-9c49-a139f2b78341 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:50.650519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:50.651185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:50.651469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:50.652212 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:50.662065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:50.663540 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:50.673257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1209/2431] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:51.059248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:51.060768 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.121891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:51.123378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.147638 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edaac8-3ef2-48eb-b94c-7bb5ceda503f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:51.147843 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd026a-0b13-444d-8163-f85022ca730f service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:51.150789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:51.151335 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:51.151693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:51.151876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:51.153468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:51.153920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.154604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:51.155035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:51.155423 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] PATH_INFO: `/v3/projects/afb65fdfb4d7481cbfce17a37019589d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:51.156845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb65fdfb4d7481cbfce17a37019589d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:51.158905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:51.168601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:51.172525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:51.174416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:51.185939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1223/2432] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:51.219194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:51.220661 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.237352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde427-e1f4-45f0-ac2c-977046a2e439 service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:51.244628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:51.244628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:51.244628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:51.244628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] PATH_INFO: `/v3/users/596ac3649c7e46bdb494635c416c9f86` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:51.245140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596ac3649c7e46bdb494635c416c9f86)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:51.247020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:51.313799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb65fdfb4d7481cbfce17a37019589d', 'request_id': 'req-5a45a508-208f-4e4d-808b-ec7b34ec9371'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.321215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb65fdfb4d7481cbfce17a37019589d', 'request_id': 'req-5a45a508-208f-4e4d-808b-ec7b34ec9371'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.327196 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb65fdfb4d7481cbfce17a37019589d', 'request_id': 'req-5a45a508-208f-4e4d-808b-ec7b34ec9371'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.424751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] The token cache is being invalidate because project afb65fdfb4d7481cbfce17a37019589d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:51.425076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.425868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.427602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1210/2433] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:51 2022] DELETE /identity/v3/projects/afb65fdfb4d7481cbfce17a37019589d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:51.431979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:51.433368 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.482871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596ac3649c7e46bdb494635c416c9f86'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.483859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596ac3649c7e46bdb494635c416c9f86'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.484724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596ac3649c7e46bdb494635c416c9f86'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.490458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:51.499901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596ac3649c7e46bdb494635c416c9f86'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.502336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a508-208f-4e4d-808b-ec7b34ec9371 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:51.507222 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:51.507868 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:51.508149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:51.508426 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] PATH_INFO: `/v3/users/970252105a15424fa28b5a80d62e793e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:51.509629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970252105a15424fa28b5a80d62e793e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:51.511599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:51.599382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596ac3649c7e46bdb494635c416c9f86'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.611732 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1224/2434] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:51 2022] DELETE /identity/v3/users/596ac3649c7e46bdb494635c416c9f86 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:51.700252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970252105a15424fa28b5a80d62e793e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.700252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970252105a15424fa28b5a80d62e793e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.706243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970252105a15424fa28b5a80d62e793e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.718999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970252105a15424fa28b5a80d62e793e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.784714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970252105a15424fa28b5a80d62e793e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:51.791414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1211/2435] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:51 2022] DELETE /identity/v3/users/970252105a15424fa28b5a80d62e793e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:51.881568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:51.883363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:51.980268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fbb28-dc74-4edf-8e34-66470d233f52 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.032090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.032776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.033059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.033429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] PATH_INFO: `/v3/projects/da515977c3d046d785b672885e77a4b2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.034615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da515977c3d046d785b672885e77a4b2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.037040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.184196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da515977c3d046d785b672885e77a4b2', 'request_id': 'req-4813ec51-fd47-4805-a0c2-5f242432f947'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.190593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da515977c3d046d785b672885e77a4b2', 'request_id': 'req-4813ec51-fd47-4805-a0c2-5f242432f947'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.265268 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.266956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.281039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8e0e-8abc-413f-808e-57c461c55a84 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.284397 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da515977c3d046d785b672885e77a4b2', 'request_id': 'req-4813ec51-fd47-4805-a0c2-5f242432f947'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.295065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:52.299495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] The token cache is being invalidate because project da515977c3d046d785b672885e77a4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:52.299812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.300459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-4813ec51-fd47-4805-a0c2-5f242432f947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.302665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1225/2436] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:51 2022] DELETE /identity/v3/projects/da515977c3d046d785b672885e77a4b2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:52.307583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda720-a4ab-443c-899b-dd904e1d1fa3 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.307867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda720-a4ab-443c-899b-dd904e1d1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.308141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda720-a4ab-443c-899b-dd904e1d1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.323670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:52.329025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bafda720-a4ab-443c-899b-dd904e1d1fa3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:52.330230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bafda720-a4ab-443c-899b-dd904e1d1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.349531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.350173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.350457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.350756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] PATH_INFO: `/v3/projects/5b511973873943558684e7ec13e10e18` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.351996 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b511973873943558684e7ec13e10e18)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.354954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.390783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1226/2437] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:52.398836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.399130 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.399408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.420250 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:52.421445 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.430212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1227/2438] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:52.434277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.443741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d973ac9-989a-41a9-b804-7e8c302c7651 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.455191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b511973873943558684e7ec13e10e18', 'request_id': 'req-28de1212-8dee-46f3-b3d1-999863d9e73a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.461703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b511973873943558684e7ec13e10e18', 'request_id': 'req-28de1212-8dee-46f3-b3d1-999863d9e73a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.467446 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b511973873943558684e7ec13e10e18', 'request_id': 'req-28de1212-8dee-46f3-b3d1-999863d9e73a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.500276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.500887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.501164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.501436 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.502162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:52.502503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.504190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.515061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1228/2439] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:16:52.519688 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.529353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fbc4b-be45-4b71-b30a-ae98fb352c77 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.534164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.534809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.535113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.535951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.536592 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.538663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.544224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] The token cache is being invalidate because project 5b511973873943558684e7ec13e10e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:52.544562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.545216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28de1212-8dee-46f3-b3d1-999863d9e73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:52.546802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1212/2440] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:52 2022] DELETE /identity/v3/projects/5b511973873943558684e7ec13e10e18 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:52.552205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad69c-ba96-4924-ad51-9e68be8b8f28 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.552561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad69c-ba96-4924-ad51-9e68be8b8f28 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.552889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad69c-ba96-4924-ad51-9e68be8b8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.572951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d06ad69c-ba96-4924-ad51-9e68be8b8f28 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:52.574144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d06ad69c-ba96-4924-ad51-9e68be8b8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.582757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1213/2441] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:52.590306 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.598449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.598449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.609581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:52.610767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.618490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1214/2442] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:52.622491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.632283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449ac78-13bf-46b4-9844-8afe20e11176 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.636869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.637459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.640858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1229/2443] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:52.642056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.642056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.642056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:52.642056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.642056 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.642549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.643389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:52.657295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1215/2444] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:16:52.658318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.668200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3c1d2-727c-429a-bd95-27c484cdb035 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.712591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb44fbc-f18f-495f-8658-9b97fceaaed5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.717845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.718467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.718774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.719062 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.719728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.721690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.731661 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.732288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.733003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.733003 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.733718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.735737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.804591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1230/2445] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:52.808693 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.813861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:52.819752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e27e-2784-48ed-b1ac-42d4ecd994d6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.824647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.825255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.825538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.825847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.826513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.828137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.831741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1216/2446] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:52.833345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.838751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:52.841965 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1231/2447] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:52.843278 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.853715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fe3e8-3f8c-489e-80c5-62f18aa3c410 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.904534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36763006-99f0-4f0a-a2d0-d9debc90b9ef admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.909255 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.909410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.909868 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.910024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.910176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.910442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.910598 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.911020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.911205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.911779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.912796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.913730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:52.922685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1232/2448] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:52.927529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:52.936874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f0dda-26a8-47b9-95be-5a1551372bcd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:52.942111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:52.942957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:52.943214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:52.943481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] PATH_INFO: `/v3/projects/a1449da259f14c949229d7537505d840/users/b5186db1e13f443cabeac282167c502f/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:52.957874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1449da259f14c949229d7537505d840, user_id=b5186db1e13f443cabeac282167c502f, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:52.960478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f13a4-0a4a-4735-88a5-ed9fe61c82f8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.071049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1217/2449] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:52 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:53.072188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.083191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4219-20ab-44d7-88ab-9f704afaf581 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.094747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1233/2450] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:52 2022] PUT /identity/v3/projects/a1449da259f14c949229d7537505d840/users/b5186db1e13f443cabeac282167c502f/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:53.105186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.105725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.106099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.136200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] MFA Rules not processed for user `b5186db1e13f443cabeac282167c502f`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:53.137534 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:53.146042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.146961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.147244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.147820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.148202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.149821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.162746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1218/2451] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:53.164038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.174412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898bd47-a4dd-46bc-894b-71e8114a507b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.179852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.180454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.180736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.181020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.181700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.185277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.199032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1219/2452] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:53.200142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.205928 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1234/2453] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:53.212015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.214993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a919ba-e82f-42de-9638-743a4d825ab6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.219848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.220628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.221013 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.221394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] PATH_INFO: `/v3/projects/b8cb6a22a6774951891489e41dbe6943/users/b64c5c9fc8814e5081d17419c2366a96/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.222161 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3002e-1245-418d-986a-db20f08cd046 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.226984 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.227573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.227853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.233950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.233950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.233950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d08c3-3488-44a6-aca8-7052d3067471 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.237468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cb6a22a6774951891489e41dbe6943, user_id=b64c5c9fc8814e5081d17419c2366a96, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.241006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.322095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1220/2454] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:53 2022] PUT /identity/v3/projects/b8cb6a22a6774951891489e41dbe6943/users/b64c5c9fc8814e5081d17419c2366a96/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:53.327560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1235/2455] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:53.328401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.333296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.333588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.333861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.361789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] MFA Rules not processed for user `b64c5c9fc8814e5081d17419c2366a96`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:53.363040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:53.384722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:53.390874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:53.396840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd29e8-c8a7-4cd5-a320-bb150f7ad5d2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.432764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1236/2456] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:53.437209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.458619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.459273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.467600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.467600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.467600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.467600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.498522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff835c37-d0e0-489b-80ff-0561ff3f0887 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.503270 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.504395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.504780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.505058 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.505717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.507717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.554815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1221/2457] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:53.557833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.568257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be350-4e4c-4649-ac8b-699c86d36220 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.572933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.573530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.573807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.574106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.574811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.576582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.587205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1222/2458] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:53.591102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.600644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa27124-a1be-4cdc-b4f8-9c66a488d1b4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.605583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.606217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.606495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.606809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] PATH_INFO: `/v3/projects/203b41a351fa4d2f9f08275a00c9158f/users/149e727021eb4edebbd71f102e61e090/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.612781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1237/2459] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:53.619953 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.623088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203b41a351fa4d2f9f08275a00c9158f, user_id=149e727021eb4edebbd71f102e61e090, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.625933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.682454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8642-adea-4943-a73f-71459139d5d8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.687481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.688140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.688424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.688699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.689392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.692018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.721729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1223/2460] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:53 2022] PUT /identity/v3/projects/203b41a351fa4d2f9f08275a00c9158f/users/149e727021eb4edebbd71f102e61e090/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:53.725643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.790332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78032364-2368-4809-9194-50f0e0832990 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.795031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.795639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.795919 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.796189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.796871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.798484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.806116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1238/2461] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:16:53.807169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.811187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1224/2462] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:53.814848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.817923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657d56-930d-420d-b3ce-d2cf03883edf admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.822588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.823256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.823527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.823805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.824571 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.825953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5622c-c355-49b0-ab76-e1bf7efcc53d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.826156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.831000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.831729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.832136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.833127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] PATH_INFO: `/v3/projects/203b41a351fa4d2f9f08275a00c9158f/users/149e727021eb4edebbd71f102e61e090/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.835269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203b41a351fa4d2f9f08275a00c9158f, user_id=149e727021eb4edebbd71f102e61e090, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.836573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1239/2463] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:53.838170 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b770d8-8543-4558-b82b-6305691199b4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.840612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.849229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1225/2464] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:53 2022] PUT /identity/v3/projects/203b41a351fa4d2f9f08275a00c9158f/users/149e727021eb4edebbd71f102e61e090/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:53.850416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2607c-cb6a-46a4-acfa-89f4d1d0aa6a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:53.861059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.861430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.861726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.872773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:53.892042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] MFA Rules not processed for user `149e727021eb4edebbd71f102e61e090`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:53.893264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:53.912234 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:53.912915 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:53.915292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:53.915292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] PATH_INFO: `/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e/users/74747da45506433cac224af9be726e34/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:53.929018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a20595b90b400aaa99f2d2ea007a4e, user_id=74747da45506433cac224af9be726e34, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:53.929801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:53.931853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:53.970640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1226/2465] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:53.983581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:53.984921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:54.007757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1240/2466] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:53 2022] PUT /identity/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e/users/74747da45506433cac224af9be726e34/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:54.011642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:54.044353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eb444-0897-457a-85f8-e04cfe22e8b5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:54.076562 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d5059-af9d-42b8-a9d8-484e6c53d55a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:54.081506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:54.082172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.082481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.082785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.083475 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:54.085190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:54.095017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1241/2467] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:16:54.095169 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:54.095658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.095944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.096223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.099745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:54.109679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbfc35-9238-4040-90b4-dbeca7b06795 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:54.115014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:54.115671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.115949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.116219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] PATH_INFO: `/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e/users/74747da45506433cac224af9be726e34/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.118266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a20595b90b400aaa99f2d2ea007a4e, user_id=74747da45506433cac224af9be726e34, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:54.120923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd385f-3ecf-476a-8259-a9c6dec00155 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:54.133467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1242/2468] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:54 2022] PUT /identity/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e/users/74747da45506433cac224af9be726e34/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:16:54.145905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.146193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.146741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.162136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:54.164769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:54.173103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1227/2469] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:16:54.175157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] MFA Rules not processed for user `74747da45506433cac224af9be726e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:54.177059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:54.245575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1243/2470] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:16:54.258482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:54.259933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:54.273321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4592b-21d5-4dd5-9d46-ee59f4e4c71e service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:54.304656 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:54.325493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:54.326171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.326377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.326652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.336818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:54.342406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:54.347826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1228/2471] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:54.382433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:54.392899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11626ca8-c13b-44e4-8fbf-ae2e9069e208 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:54.397164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:54.399897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:54.399897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:54.399897 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:54.410869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:54.457003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:54.458626 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:54.467739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1244/2472] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:55.401869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:55.411915 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fa3d2-ed9d-4d11-8ff0-2baebbcfd86f service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:55.416559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74747da45506433cac224af9be726e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a20595b90b400aaa99f2d2ea007a4e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:55.417163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:55.417449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:55.417726 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:55.418414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:55.418731 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:55.420356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:55.432370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1229/2473] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:55.436431 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:55.447301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6be993-41c6-4221-b187-7b55a47e395e service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:55.451847 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74747da45506433cac224af9be726e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a20595b90b400aaa99f2d2ea007a4e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:55.452457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:55.452745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:55.453027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:55.456134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:55.456134 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:55.539750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1245/2474] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:55 2022] POST /identity/v3/projects => generated 354 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:55.543763 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:55.553954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45d9-484e-4741-8fb9-09c1bf1ca2f0 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:55.609753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74747da45506433cac224af9be726e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a20595b90b400aaa99f2d2ea007a4e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:55.610365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:55.610650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:55.610958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:55.611645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:55.611953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:55.613583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:55.625165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1230/2475] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:55.665111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:55.675468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6422ed-5430-4256-b31f-81d380634a59 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:55.680171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74747da45506433cac224af9be726e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4a20595b90b400aaa99f2d2ea007a4e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:55.680808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:55.681094 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:55.681371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] PATH_INFO: `/v3/projects/f527da6719de4770b6e82dfdbc6ae7c4` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:55.682529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f527da6719de4770b6e82dfdbc6ae7c4)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:55.684495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:55.853183 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f527da6719de4770b6e82dfdbc6ae7c4', 'request_id': 'req-abbf94a2-5d63-4d89-a799-86d3804b8342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:55.858695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f527da6719de4770b6e82dfdbc6ae7c4', 'request_id': 'req-abbf94a2-5d63-4d89-a799-86d3804b8342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:55.933168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f527da6719de4770b6e82dfdbc6ae7c4', 'request_id': 'req-abbf94a2-5d63-4d89-a799-86d3804b8342'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:55.947359 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] The token cache is being invalidate because project f527da6719de4770b6e82dfdbc6ae7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:55.947651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:55.948346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-abbf94a2-5d63-4d89-a799-86d3804b8342 tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:55.959845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1246/2476] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:55 2022] DELETE /identity/v3/projects/f527da6719de4770b6e82dfdbc6ae7c4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:56.678850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:56.682578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:56.757531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd20f4-7e44-46ff-80bd-618a528ba0ae tempest-VolumeQuotaClassesTest-1582386556 tempest-VolumeQuotaClassesTest-1582386556-project-admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:56.818626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:56.818626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:56.818626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:56.818963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] PATH_INFO: `/v3/users/b64c5c9fc8814e5081d17419c2366a96` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:56.819888 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64c5c9fc8814e5081d17419c2366a96)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:56.821796 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:56.824163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:56.986936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64c5c9fc8814e5081d17419c2366a96'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:56.987596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64c5c9fc8814e5081d17419c2366a96'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:56.994762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64c5c9fc8814e5081d17419c2366a96'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.007075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64c5c9fc8814e5081d17419c2366a96'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.055482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64c5c9fc8814e5081d17419c2366a96'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.062063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1231/2477] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:56 2022] DELETE /identity/v3/users/b64c5c9fc8814e5081d17419c2366a96 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:57.067337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:57.067830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:57.067931 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:57.087325 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:57.088519 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:57.148561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1247/2478] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:57.158310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:57.159856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:57.217682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa4b96-8531-4897-8546-a10afa8de71e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:57.221398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:57.222012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:57.222291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:57.222580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:57.231921 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:57.233477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:57.243318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1232/2479] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:16:57.701676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:57.707792 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:57.716074 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72811-b4cc-426f-ac85-14f6fc792a1f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:57.723145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:57.723740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:57.724006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:57.724285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] PATH_INFO: `/v3/projects/b8cb6a22a6774951891489e41dbe6943` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:57.725481 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cb6a22a6774951891489e41dbe6943)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:57.727433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:57.741902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:57.836472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cb6a22a6774951891489e41dbe6943', 'request_id': 'req-b1950d5f-31d5-467a-8eb6-6d5d50c78292'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.845174 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cb6a22a6774951891489e41dbe6943', 'request_id': 'req-b1950d5f-31d5-467a-8eb6-6d5d50c78292'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.930265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cb6a22a6774951891489e41dbe6943', 'request_id': 'req-b1950d5f-31d5-467a-8eb6-6d5d50c78292'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.942027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] The token cache is being invalidate because project b8cb6a22a6774951891489e41dbe6943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:57.942261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.942946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:57.944535 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1248/2480] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:57 2022] DELETE /identity/v3/projects/b8cb6a22a6774951891489e41dbe6943 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:57.948614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:57.960437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0ea99-b360-4364-95a8-0503d3ffe9c2 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:58.017942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:58.018576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:58.018899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:58.019177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] PATH_INFO: `/v3/users/74747da45506433cac224af9be726e34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:58.020665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74747da45506433cac224af9be726e34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:58.022886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:58.142174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:58.217631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74747da45506433cac224af9be726e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.218219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74747da45506433cac224af9be726e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.225882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74747da45506433cac224af9be726e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.239279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74747da45506433cac224af9be726e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.344123 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1acae8ba-33a5-4a25-b6c5-358bedaa2ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74747da45506433cac224af9be726e34'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.351270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1233/2481] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:16:57 2022] DELETE /identity/v3/users/74747da45506433cac224af9be726e34 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:58.758150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:58.759778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:58.774539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1950d5f-31d5-467a-8eb6-6d5d50c78292 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:58.836699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:58.837349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:58.837629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:58.837904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] PATH_INFO: `/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:58.839104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a20595b90b400aaa99f2d2ea007a4e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:58.841061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:58.933107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a20595b90b400aaa99f2d2ea007a4e', 'request_id': 'req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:58.938560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a20595b90b400aaa99f2d2ea007a4e', 'request_id': 'req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:59.001221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a20595b90b400aaa99f2d2ea007a4e', 'request_id': 'req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:59.013453 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] The token cache is being invalidate because project d4a20595b90b400aaa99f2d2ea007a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:16:59.013738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:59.014380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-6925580d-cf9c-41c4-aca6-c2fb0ffd351a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:16:59.015918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1249/2482] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:16:58 2022] DELETE /identity/v3/projects/d4a20595b90b400aaa99f2d2ea007a4e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:59.021548 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.022018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.022159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.042756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:59.043905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:59.103367 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1234/2483] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:59.111081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.111471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.111837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.131909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:59.133114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:59.141238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1250/2484] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:59.146148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.156209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b293728-3e9c-4146-8ebc-5363202a808f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.161713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.164890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.164890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.164890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.164890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:16:59.164890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.165550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.177717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1235/2485] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:16:59.182026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.191320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a36747-e31d-4dbc-8b33-20976004fe2f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.195946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.196554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.196838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.197116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.197773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.199725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.309971 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:59.321564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1251/2486] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:16:59 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:59.328980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.341057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8c9ba-1ffd-45f9-af7a-449c3b770f7e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.401475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.402091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.402371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.402642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.403455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.405376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.514460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1236/2487] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:16:59 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:16:59.518757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.530485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e487b-05c9-45b2-87a0-4c3c6de2dc71 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.536198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.536864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.537225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.537860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.538294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.539950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.549993 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1252/2488] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:59.554926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.565066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ed9ce-b783-457b-b7c6-25ba4d3bc8e5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.570681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.571320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.571625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.571924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.572611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.574202 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5873c3-cbe9-4229-94c1-1b149ea418a1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.585648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1237/2489] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:16:59.589659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.600179 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a3fe7-76b6-405e-93aa-2a8b69d1e598 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.607344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.608056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.608341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.608679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] PATH_INFO: `/v3/projects/554d7e3dd15e4a98a8e29174a384bd34/users/c21cb8ec1c474e23a1b1838f76d4fd17/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.625020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554d7e3dd15e4a98a8e29174a384bd34, user_id=c21cb8ec1c474e23a1b1838f76d4fd17, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.627828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.757552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1253/2490] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:16:59 2022] PUT /identity/v3/projects/554d7e3dd15e4a98a8e29174a384bd34/users/c21cb8ec1c474e23a1b1838f76d4fd17/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:16:59.762587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.762927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.763208 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.784037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:16:59.785546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:59.789976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:16:59.853325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1238/2491] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:16:59.862940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:16:59.865725 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:16:59.926633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47f84-0a29-4f07-b686-c140f54bdb89 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:16:59.930579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:16:59.931227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:16:59.931511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:16:59.931788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:16:59.941198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:16:59.943415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f455-a877-4ffc-83ad-8753fd8bda67 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:16:59.953119 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1254/2492] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:00.387831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:00.389292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:00.401855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55066430-d406-4103-81cc-32d3c431efc7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:00.408377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:00.408377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:00.408377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:00.408377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] PATH_INFO: `/v3/users/0c42333945ad4d4dae5a92a2c080111c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:00.408873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c42333945ad4d4dae5a92a2c080111c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:00.411131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:00.635587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c42333945ad4d4dae5a92a2c080111c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:00.636167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c42333945ad4d4dae5a92a2c080111c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:00.643450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c42333945ad4d4dae5a92a2c080111c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:00.655914 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c42333945ad4d4dae5a92a2c080111c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:00.758583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c42333945ad4d4dae5a92a2c080111c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:00.765785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1239/2493] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:00 2022] DELETE /identity/v3/users/0c42333945ad4d4dae5a92a2c080111c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:00.770817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba148-3442-4280-aee8-36bff62ee9a7 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:00.771105 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba148-3442-4280-aee8-36bff62ee9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:00.771641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ba148-3442-4280-aee8-36bff62ee9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:00.790334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6d1ba148-3442-4280-aee8-36bff62ee9a7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:00.791577 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6d1ba148-3442-4280-aee8-36bff62ee9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:00.856000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1255/2494] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:00.862421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:00.864119 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:00.927361 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80ff24-5ec6-47c7-891e-bdb545c48eb9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:00.931769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:00.932380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:00.932660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:00.932933 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:00.942767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:00.944205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:00.953823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1240/2495] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:01.368929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.369414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.369500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.409954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] MFA Rules not processed for user `c21cb8ec1c474e23a1b1838f76d4fd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:01.411598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.436448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.438993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.456987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9941-b188-4b8d-90a7-2747019879da service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.462788 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.464232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.464750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.465227 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] PATH_INFO: `/v3/projects/9f4e4cbb44004c13b55dab4ba6e2f84a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.467693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4e4cbb44004c13b55dab4ba6e2f84a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.470321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.502578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:01.521719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:01.529636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1256/2496] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:01.533975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.536090 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.550171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4556c-e7bd-4f7c-83df-5bbcefdf6a89 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.555376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.558295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.558295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.558295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.558295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.559123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.590767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4e4cbb44004c13b55dab4ba6e2f84a', 'request_id': 'req-9558685a-702a-49c8-9bee-ad8dd7550752'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:01.596971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4e4cbb44004c13b55dab4ba6e2f84a', 'request_id': 'req-9558685a-702a-49c8-9bee-ad8dd7550752'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:01.603058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4e4cbb44004c13b55dab4ba6e2f84a', 'request_id': 'req-9558685a-702a-49c8-9bee-ad8dd7550752'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:01.709714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] The token cache is being invalidate because project 9f4e4cbb44004c13b55dab4ba6e2f84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:01.715905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:01.715905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9558685a-702a-49c8-9bee-ad8dd7550752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:01.716261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1257/2497] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:01.716387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1241/2498] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:01 2022] DELETE /identity/v3/projects/9f4e4cbb44004c13b55dab4ba6e2f84a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:01.716483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.716865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648d6f-cb50-442a-b5fc-c24a5e003fe1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.717164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648d6f-cb50-442a-b5fc-c24a5e003fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.717439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648d6f-cb50-442a-b5fc-c24a5e003fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.718093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.737739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-63648d6f-cb50-442a-b5fc-c24a5e003fe1 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:01.739666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63648d6f-cb50-442a-b5fc-c24a5e003fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.786187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ec31d-0e4b-40a7-b910-fe9026589177 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.791757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.792411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.792681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.792958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.793618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.795585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.806769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1242/2499] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:01.817850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.818205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.818486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.838660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:01.839917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:01.851203 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1243/2500] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:01.855625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.865252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1ca8-fa5f-48df-b1fa-6db9c87b2cd7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.869883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.870468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.870775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.871052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.871729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:01.872032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.873617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.885589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1244/2501] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:01.889810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.899894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06520d-ca8f-4047-bab5-1b46351dca41 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.904507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.905080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.905362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.905638 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.906278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.908181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.922287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1258/2502] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:01.926565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.937117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c4445-b141-49f1-a94f-03a1a2b7acec admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.942500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.943232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.943513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.943794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.946745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.946745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:01.956040 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1259/2503] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:01.959889 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:01.969432 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae075-cd21-4fef-98d4-6e0ddae37e8d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:01.974651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:01.975367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:01.975651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:01.975926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] PATH_INFO: `/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6/users/0ade5679ab9242b6b10da66841c88f31/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:01.991490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cfca87ac5c4a3d89a5dea4a3a66aa6, user_id=0ade5679ab9242b6b10da66841c88f31, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:01.994843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.077245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1245/2504] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:01 2022] POST /identity/v3/projects => generated 397 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:02.081280 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.118198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1260/2505] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:01 2022] PUT /identity/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6/users/0ade5679ab9242b6b10da66841c88f31/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:02.122076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.143481 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0dbfa-9f09-42dc-8dbc-ed4a90390e1b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.170221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:02.184855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eefa7-1ba4-44c1-83f4-1f54091795d0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.189606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.190295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.190503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.190815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.191568 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.193743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.203531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1261/2506] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:02.205458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.205458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.205458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.205792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.206434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.207745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.208645 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.217470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061fff9-7502-4086-b37f-7de74c5ba9e6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.222194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.223422 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.223705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.223982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] PATH_INFO: `/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6/users/0ade5679ab9242b6b10da66841c88f31/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.225951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cfca87ac5c4a3d89a5dea4a3a66aa6, user_id=0ade5679ab9242b6b10da66841c88f31, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.228620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.239368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1262/2507] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:02 2022] PUT /identity/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6/users/0ade5679ab9242b6b10da66841c88f31/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:02.289960 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1246/2508] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:02 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:02.294363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.308414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:02.358052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba4c4-0938-4b34-99e2-f7a5e26ab07f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.362803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.363428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.363746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.364052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.364746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.366348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.376644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1263/2509] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:02.381098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.391497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f498-4f8f-44d1-9c1f-1aeae28b287b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.397463 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.398181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.398525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.398831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.399521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.401116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458d885-14f1-48ee-8ea8-b0db427f3d55 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.411741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1247/2510] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:02.416171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.427547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36a40d-654e-4c8a-b836-afcb1c1a3961 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.432641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.433463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.433750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.434050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] PATH_INFO: `/v3/projects/0c7e12ac01d24fd6af11386491ddf0d2/users/61c7bb89840a4872ba0fd0bba46c6f5a/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.450190 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7e12ac01d24fd6af11386491ddf0d2, user_id=61c7bb89840a4872ba0fd0bba46c6f5a, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.453046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.537089 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1264/2511] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:02 2022] PUT /identity/v3/projects/0c7e12ac01d24fd6af11386491ddf0d2/users/61c7bb89840a4872ba0fd0bba46c6f5a/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:02.548416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.548817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.548969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.578624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] MFA Rules not processed for user `61c7bb89840a4872ba0fd0bba46c6f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:02.579894 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:02.647155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1248/2512] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:02.658502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:02.660201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:02.722114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06e4cd-3cde-4fc6-8ab6-e60c207b83fd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:02.727247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:02.727885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:02.728173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:02.728434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:02.737221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:02.738836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725c425-4490-449a-bddc-2b0c72862cf5 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:02.751373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1265/2513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:03.242317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:03.244076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.317138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0efbd-99da-4c95-a1b0-61786cf3c9d5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:03.321764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:03.322401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.322681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.322991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] PATH_INFO: `/v3/users/b5186db1e13f443cabeac282167c502f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.324155 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5186db1e13f443cabeac282167c502f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:03.326085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:03.351432 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:03.552891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5186db1e13f443cabeac282167c502f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:03.553537 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5186db1e13f443cabeac282167c502f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:03.560299 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5186db1e13f443cabeac282167c502f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:03.581265 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623051-1a30-4fd5-9bf1-4787fe082125 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.581728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623051-1a30-4fd5-9bf1-4787fe082125 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.581907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5623051-1a30-4fd5-9bf1-4787fe082125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.589596 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5186db1e13f443cabeac282167c502f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:03.627839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d5623051-1a30-4fd5-9bf1-4787fe082125 None None] MFA Rules not processed for user `0ade5679ab9242b6b10da66841c88f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:03.631123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d5623051-1a30-4fd5-9bf1-4787fe082125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.661190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-51c83f9f-5355-4b20-80c4-d12362ec3d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5186db1e13f443cabeac282167c502f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:03.682199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1249/2514] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:03 2022] DELETE /identity/v3/users/b5186db1e13f443cabeac282167c502f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:03.686561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.686853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.687130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.718263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:03.720750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.730586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1266/2515] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:03.744027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.744399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.744744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.765121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] MFA Rules not processed for user `c21cb8ec1c474e23a1b1838f76d4fd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:03.766330 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.775506 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:03.792649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1250/2516] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:03.799857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:03.801904 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.828421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1267/2517] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:03.842002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:03.843465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.860715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219714-f4c7-4d7d-9a2b-d4d755e5535c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:03.865519 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:03.865835 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.866231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.866513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.875674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:03.877143 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:03.886822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1251/2518] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:03.921549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb15564-2021-40e8-acf4-399579ea0be1 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:03.928350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:03.929027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:03.929315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:03.929591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:03.931419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:03.944511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:03.946243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:03.956169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1268/2519] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:04.233366 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:04.242602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d0bb-1522-4ded-ac8b-7c96d0beb1c4 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:04.246188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:04.246827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:04.247107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:04.247378 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:04.249330 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:04.261209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:04.262974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:04.273135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1252/2520] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:04.343764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:04.345323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:04.361815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192411a-ec54-4ae3-a175-3d574cc75a1b service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:04.369158 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:04.371437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:04.371437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:04.371437 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] PATH_INFO: `/v3/projects/a1449da259f14c949229d7537505d840` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:04.372109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1449da259f14c949229d7537505d840)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:04.374500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:04.486558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1449da259f14c949229d7537505d840', 'request_id': 'req-cda4cb1c-700e-4993-9475-291773c4d307'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.492934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1449da259f14c949229d7537505d840', 'request_id': 'req-cda4cb1c-700e-4993-9475-291773c4d307'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.561245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1449da259f14c949229d7537505d840', 'request_id': 'req-cda4cb1c-700e-4993-9475-291773c4d307'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.572945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] The token cache is being invalidate because project a1449da259f14c949229d7537505d840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:04.573257 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.573891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.575544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1269/2521] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:04 2022] DELETE /identity/v3/projects/a1449da259f14c949229d7537505d840 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:04.579727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:04.591036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55089bba-ad12-4a0d-9026-b10c5e7c38ad service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:04.621099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:04.661241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:04.661990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:04.662359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:04.662696 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] PATH_INFO: `/v3/users/149e727021eb4edebbd71f102e61e090` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:04.664099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=149e727021eb4edebbd71f102e61e090)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:04.666882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:04.845304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149e727021eb4edebbd71f102e61e090'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.845997 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149e727021eb4edebbd71f102e61e090'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.853855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149e727021eb4edebbd71f102e61e090'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.866054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149e727021eb4edebbd71f102e61e090'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.973836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-67bbe3e1-2b51-4021-8416-261f101aef7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149e727021eb4edebbd71f102e61e090'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:04.980860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1253/2522] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:04 2022] DELETE /identity/v3/users/149e727021eb4edebbd71f102e61e090 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:05.463714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:05.465416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:05.481480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4cb1c-700e-4993-9475-291773c4d307 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:05.512896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:05.546024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:05.546678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:05.546996 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:05.547277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] PATH_INFO: `/v3/projects/203b41a351fa4d2f9f08275a00c9158f` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:05.548471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=203b41a351fa4d2f9f08275a00c9158f)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:05.550456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:05.697434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203b41a351fa4d2f9f08275a00c9158f', 'request_id': 'req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:05.703194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203b41a351fa4d2f9f08275a00c9158f', 'request_id': 'req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:05.800100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203b41a351fa4d2f9f08275a00c9158f', 'request_id': 'req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:05.808372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] The token cache is being invalidate because project 203b41a351fa4d2f9f08275a00c9158f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:05.808578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:05.809220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2dfc1e85-ebef-4ed6-861d-b78c774ba1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:05.810817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1270/2523] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:05 2022] DELETE /identity/v3/projects/203b41a351fa4d2f9f08275a00c9158f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:05.815959 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:05.816418 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:05.817162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:05.837134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:05.838323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:05.897729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1254/2524] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:05.905544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:05.905834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:05.906117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:05.927400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:05.928640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:05.936749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1271/2525] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:05.941177 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:05.951652 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198d66-ec23-4c6b-ba29-2161a1a85bd0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:05.956311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:05.956936 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:05.957852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:05.957852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:05.958190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:05.958491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:05.960130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:05.972108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1255/2526] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:05.977110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:05.986704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c286cd-7b22-4b01-ae67-1676d0653552 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:05.993129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da65f-021a-459a-bff6-84068579248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:05.993741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da65f-021a-459a-bff6-84068579248f admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:05.994072 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da65f-021a-459a-bff6-84068579248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:05.994349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058da65f-021a-459a-bff6-84068579248f admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:05.995084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da65f-021a-459a-bff6-84068579248f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:05.997045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058da65f-021a-459a-bff6-84068579248f admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.062833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1272/2527] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:05 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:06.067005 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.077213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b72a9-ce29-4d8b-8082-fb98b96c9339 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.110581 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:06.134216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.134883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.135165 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.135441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.136218 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.138038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.263442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1256/2528] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:06 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:06.267434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da65f-021a-459a-bff6-84068579248f admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.283123 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058da65f-021a-459a-bff6-84068579248f admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.283975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.284724 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.285014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.285852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.286675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.288343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.299687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1273/2529] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:06.304484 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.315430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd120d-4c13-4978-82c7-ceac70c45900 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.320554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.321249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.321603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.321953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.322880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.324568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5dcba6-7e9d-4ed3-9aea-ad366adf78db admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.340520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1257/2530] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:06.341682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.354146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1dee2-5780-454e-9563-777c2babf579 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.364299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.364979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.365260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.365533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] PATH_INFO: `/v3/projects/1a0a91076a11480a84a25c06a9a594c6/users/3b5180fc4adc4ab88d283d621a2f70ac/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.389728 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0a91076a11480a84a25c06a9a594c6, user_id=3b5180fc4adc4ab88d283d621a2f70ac, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.392434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.493777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1274/2531] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:06 2022] PUT /identity/v3/projects/1a0a91076a11480a84a25c06a9a594c6/users/3b5180fc4adc4ab88d283d621a2f70ac/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:06.496384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.496676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.496956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.528171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] MFA Rules not processed for user `3b5180fc4adc4ab88d283d621a2f70ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:06.529498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:06.596431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1258/2532] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:06.601646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.653008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:06.664024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b26c-0c14-4741-a73f-3b49279f0777 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.668899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.669508 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.669790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.670064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.670761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.672673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.757805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1275/2533] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:06 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:06.761951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.773942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af08bf-9299-40f2-a73a-1ea4a516b66e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.836036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.842895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.842895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.842895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.842895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.842895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.922206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1259/2534] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:06 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:06.928116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.938465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a6cb-ce28-41ba-b5bb-22661961ebe2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.944516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.945142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.945430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.945706 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.946404 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.948075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:06.959103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1276/2535] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:06.963668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:06.974495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37890ff1-8808-4b5a-bb73-de0f9786d049 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:06.979175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:06.979838 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:06.980113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:06.980387 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] PATH_INFO: `/v3/projects/fa332c0ce20241279386fe14b67dbaa7/users/2d25e4cdfb054c4e81cb6960ce7406c1/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:06.995508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa332c0ce20241279386fe14b67dbaa7, user_id=2d25e4cdfb054c4e81cb6960ce7406c1, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:06.998151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:07.099311 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1260/2536] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:06 2022] PUT /identity/v3/projects/fa332c0ce20241279386fe14b67dbaa7/users/2d25e4cdfb054c4e81cb6960ce7406c1/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:07.103617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:07.114527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e42d97-651d-4a1d-bc6d-29af3c3521dd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:07.172675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:07.173306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:07.173589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:07.173869 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:07.174569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:07.176752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ba282-01f5-4cb6-baae-9f3dd53dbc70 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:07.187447 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1277/2537] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:07.192288 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:07.203416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43ff2-4b35-4e19-a82f-30b6f18a2b56 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:07.208776 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:07.209472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:07.209818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:07.210153 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] PATH_INFO: `/v3/projects/fa332c0ce20241279386fe14b67dbaa7/users/2d25e4cdfb054c4e81cb6960ce7406c1/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:07.212360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa332c0ce20241279386fe14b67dbaa7, user_id=2d25e4cdfb054c4e81cb6960ce7406c1, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:07.215186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:07.221032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:07.226543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1261/2538] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:07 2022] PUT /identity/v3/projects/fa332c0ce20241279386fe14b67dbaa7/users/2d25e4cdfb054c4e81cb6960ce7406c1/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:07.236741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:07.237208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:07.237491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:07.268156 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] MFA Rules not processed for user `2d25e4cdfb054c4e81cb6960ce7406c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:07.269446 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:07.341258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1278/2539] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:07.351968 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:07.353647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:07.413216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff2ba-7589-467f-9075-75aa8ef158aa admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:07.417049 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:07.417666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:07.417944 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:07.418214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:07.428693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:07.430141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:07.440272 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1262/2540] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:07.489141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:07.490778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:07.503415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa950d8-0cd3-479a-820a-ec57baea3037 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:07.507533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:07.508238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:07.508585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:07.508930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:07.574961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:07.588818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:07.590289 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d9ab-72d4-43a2-ba02-091e17f4c59b service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:07.600764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1279/2541] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:08.838606 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:08.840214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:08.904541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf267edf-f61a-4e82-8941-fafb7c149383 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:08.909182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:08.910118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:08.910118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:08.910464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] PATH_INFO: `/v3/users/61c7bb89840a4872ba0fd0bba46c6f5a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:08.911721 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c7bb89840a4872ba0fd0bba46c6f5a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:08.913676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:09.180766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c7bb89840a4872ba0fd0bba46c6f5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:09.181450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c7bb89840a4872ba0fd0bba46c6f5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:09.196655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c7bb89840a4872ba0fd0bba46c6f5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:09.212452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c7bb89840a4872ba0fd0bba46c6f5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:09.281917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c7bb89840a4872ba0fd0bba46c6f5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:09.289328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1263/2542] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:08 2022] DELETE /identity/v3/users/61c7bb89840a4872ba0fd0bba46c6f5a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:09.294382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:09.294903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:09.295004 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:09.314316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:09.315624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:09.376877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1280/2543] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:09.387228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:09.388787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:09.413160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:09.450064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa101b1-5521-41f7-a8bd-53c91c03db32 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:09.453732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:09.454355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:09.454637 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:09.454946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:09.466990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:09.466990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc191b0-fb44-407d-8aab-247818c8f820 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:09.475552 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1264/2544] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:10.074352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.075925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:10.088648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f90664-2595-4cd0-908b-158c5f428880 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.093313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.093964 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.094259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.094593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] PATH_INFO: `/v3/projects/0c7e12ac01d24fd6af11386491ddf0d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.095733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7e12ac01d24fd6af11386491ddf0d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.097628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.198154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7e12ac01d24fd6af11386491ddf0d2', 'request_id': 'req-010c65d9-9155-4f32-80b9-2fa5fcd068b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:10.203901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7e12ac01d24fd6af11386491ddf0d2', 'request_id': 'req-010c65d9-9155-4f32-80b9-2fa5fcd068b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:10.255735 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7e12ac01d24fd6af11386491ddf0d2', 'request_id': 'req-010c65d9-9155-4f32-80b9-2fa5fcd068b6'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:10.267312 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] The token cache is being invalidate because project 0c7e12ac01d24fd6af11386491ddf0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:10.267603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:10.268632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-010c65d9-9155-4f32-80b9-2fa5fcd068b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:10.274501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1281/2545] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:10 2022] DELETE /identity/v3/projects/0c7e12ac01d24fd6af11386491ddf0d2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:10.276183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.276625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.276744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.297920 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:10.302792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:10.372900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1265/2546] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:10.380401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.380901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.381008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.402245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:10.405191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:10.414148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1282/2547] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:10.419039 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.429869 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23573fe-1c9b-4f94-a82e-e7e987e76e99 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.434829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.435461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.435747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.436022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.436748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:10.437074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.438733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.451736 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1266/2548] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:10.456042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.466083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df1672-d47d-4727-9fca-630ed7c6188f None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.470884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.474755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.474755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.474755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.474755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.475260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.580342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1283/2549] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:10 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:10.584719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.594848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fae388-2807-4780-addb-d71d3774fae6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.653633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.654250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.654531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.654836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.655495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.657444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.793922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1267/2550] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:10 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:10.795176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.805944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4cfa-ceb5-42d2-a74e-dc381e724ce0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.810472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.811117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.811398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.811673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.812362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.813991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.823715 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1284/2551] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:10.827632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.838116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5e468-24ff-4561-a9ea-ff2631d53dd1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.842695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.845175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.845175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.845175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.845175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.846404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec43c40-e78a-42ed-9c4e-f5e48a3b3612 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.857640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1268/2552] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:10.861703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:10.871913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c887f12-e45c-4874-b0d7-a830930addfd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:10.876496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:10.877147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.877429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.877705 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] PATH_INFO: `/v3/projects/73d7f2a77b514846ae3a4f6c512701d2/users/f17178cb25424167a1e55d5a3692461b/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.892379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d7f2a77b514846ae3a4f6c512701d2, user_id=f17178cb25424167a1e55d5a3692461b, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:10.895801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:10.967376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1285/2553] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:10 2022] PUT /identity/v3/projects/73d7f2a77b514846ae3a4f6c512701d2/users/f17178cb25424167a1e55d5a3692461b/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:10.972686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:10.973054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:10.973406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:10.993363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:10.994579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:11.019777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:11.054931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1269/2554] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:11.064871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:11.067468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:11.077412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:11.123733 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024bfb-68d6-4ec0-807a-200c95be38a9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:11.127819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:11.128027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:11.128314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:11.128712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:11.138778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:11.140461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc8396-028f-4612-b364-49267285fa28 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:11.150488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1286/2555] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:12.701562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:12.704824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:12.717122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f494a-a22a-4930-87df-57ff0b110313 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:12.723681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:12.724338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:12.724612 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:12.725111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] PATH_INFO: `/v3/users/3b5180fc4adc4ab88d283d621a2f70ac` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:12.726347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5180fc4adc4ab88d283d621a2f70ac)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:12.728439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:12.956038 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5180fc4adc4ab88d283d621a2f70ac'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:12.956705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5180fc4adc4ab88d283d621a2f70ac'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:12.967017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5180fc4adc4ab88d283d621a2f70ac'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:12.979359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5180fc4adc4ab88d283d621a2f70ac'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:13.099586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5180fc4adc4ab88d283d621a2f70ac'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:13.107410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1270/2556] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:12 2022] DELETE /identity/v3/users/3b5180fc4adc4ab88d283d621a2f70ac => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:13.111863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:13.112367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:13.112491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:13.132720 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:13.133934 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:13.201186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1287/2557] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:13.219913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:13.221655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:13.320160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ce47-411d-46f4-8dbc-7fe91df2e9f0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:13.325739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:13.326910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:13.327503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:13.328001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:13.342878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:13.346107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:13.366075 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1271/2558] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:14.011321 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:14.012746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:14.026214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689f58-ffd4-4677-80d8-0d2808a5b009 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:14.030853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:14.031495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:14.031775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:14.032056 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] PATH_INFO: `/v3/projects/1a0a91076a11480a84a25c06a9a594c6` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:14.033205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0a91076a11480a84a25c06a9a594c6)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:14.035285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:14.155814 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0a91076a11480a84a25c06a9a594c6', 'request_id': 'req-d4b2488e-de7e-427c-ac67-881265b5580d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.163930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0a91076a11480a84a25c06a9a594c6', 'request_id': 'req-d4b2488e-de7e-427c-ac67-881265b5580d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.235885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0a91076a11480a84a25c06a9a594c6', 'request_id': 'req-d4b2488e-de7e-427c-ac67-881265b5580d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.248418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] The token cache is being invalidate because project 1a0a91076a11480a84a25c06a9a594c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:14.252267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.252267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.252267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1288/2559] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:14 2022] DELETE /identity/v3/projects/1a0a91076a11480a84a25c06a9a594c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:14.255719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:14.266523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abade-d105-409d-9c46-1f86f4a10713 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:14.317938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:14.335893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:14.338117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:14.338117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:14.338117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] PATH_INFO: `/v3/users/2d25e4cdfb054c4e81cb6960ce7406c1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:14.339344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d25e4cdfb054c4e81cb6960ce7406c1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:14.341642 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:14.567350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d25e4cdfb054c4e81cb6960ce7406c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.568191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d25e4cdfb054c4e81cb6960ce7406c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.580534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d25e4cdfb054c4e81cb6960ce7406c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.601338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d25e4cdfb054c4e81cb6960ce7406c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.702004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8186b7da-480b-4681-9d6d-11011f10a9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d25e4cdfb054c4e81cb6960ce7406c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:14.714800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1272/2560] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:14 2022] DELETE /identity/v3/users/2d25e4cdfb054c4e81cb6960ce7406c1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:15.418053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:15.419859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:15.440409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2488e-de7e-427c-ac67-881265b5580d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:15.476478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:15.508852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:15.510160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:15.510434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:15.515748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] PATH_INFO: `/v3/projects/fa332c0ce20241279386fe14b67dbaa7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:15.515748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa332c0ce20241279386fe14b67dbaa7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:15.515748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:15.634918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa332c0ce20241279386fe14b67dbaa7', 'request_id': 'req-e7d3b537-c367-4a4c-9d28-631983890ddd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:15.640962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa332c0ce20241279386fe14b67dbaa7', 'request_id': 'req-e7d3b537-c367-4a4c-9d28-631983890ddd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:15.704876 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa332c0ce20241279386fe14b67dbaa7', 'request_id': 'req-e7d3b537-c367-4a4c-9d28-631983890ddd'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:15.717811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] The token cache is being invalidate because project fa332c0ce20241279386fe14b67dbaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:15.718203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:15.718978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e7d3b537-c367-4a4c-9d28-631983890ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:15.720778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1289/2561] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:15 2022] DELETE /identity/v3/projects/fa332c0ce20241279386fe14b67dbaa7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:15.726530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:15.727132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:15.727132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:15.748149 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:15.749693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:15.825793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1273/2562] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:15.833612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:15.833891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:15.834362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:15.855781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:15.857081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:15.867507 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1290/2563] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:15.871798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:15.882247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53884-e5b8-4e38-9558-94d8aa1c2f68 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:15.887523 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:15.888198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:15.888808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:15.889409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:15.890305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:15.890801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:15.892599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:15.906146 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1274/2564] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:15.911380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:15.920618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d804e-315b-4d4e-85e6-b39de50be628 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:15.925423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:15.926599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:15.926995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:15.927273 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:15.927950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:15.931087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.099703 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1291/2565] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:15 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:16.100926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.111725 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b332-e55d-4ddf-b4a0-59fff8d31a89 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.177769 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:16.188529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.191716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.191716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.191716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.191716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.192698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.276220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1275/2566] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:16 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:16.280871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.305903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a8217-4d4c-4f3a-b40c-522cb27a0e73 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.310885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.311548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.311880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.312165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.312873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.314580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.325683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1292/2567] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:16.329559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.340430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07d589-b519-4784-b6c4-37d53c29c197 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.345745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.346455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.346779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.347061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.348458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.350290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5a2b6-c335-4d0f-a200-16851481d322 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.363703 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1276/2568] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:16.367751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.378423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb558-3651-4a38-a310-26b724529bcd admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.386682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.387520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.387866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.388341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] PATH_INFO: `/v3/projects/8c6070505a93488c984bf118cb6de436/users/df67bf1d4e3a4aed8630d610a2ab9abe/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.408051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6070505a93488c984bf118cb6de436, user_id=df67bf1d4e3a4aed8630d610a2ab9abe, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.411550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.475485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1293/2569] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:16 2022] PUT /identity/v3/projects/8c6070505a93488c984bf118cb6de436/users/df67bf1d4e3a4aed8630d610a2ab9abe/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:16.488243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.489054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.489397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.527879 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] MFA Rules not processed for user `df67bf1d4e3a4aed8630d610a2ab9abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:16.529245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:16.608267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1277/2570] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:16.614997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.681309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862673b6-ec83-49ab-9196-280086663b06 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.691398 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.692570 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.692850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.693367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.694874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.699269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:16.795842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1294/2571] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:16 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:16.799803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:16.812201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99b556-6455-4020-8fab-cc02396f1135 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:16.877827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:16.878531 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:16.880082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:16.880082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:16.880671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:16.882865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.001900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1278/2572] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:16 2022] POST /identity/v3/users => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:17.006813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.018844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b42aaa-4ce2-4d17-8649-18a6fd94557e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.024524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.025178 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.025458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.025734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.026433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.028433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.052412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1295/2573] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:17.056751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.068492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09df417-eb0b-4915-95e5-2f2df06e1cbc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.074815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.075517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.075798 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.076136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] PATH_INFO: `/v3/projects/34d7c6be224944739bcf3331bfe4563c/users/2f5597cbb4db4e02991825479c0534be/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.094521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d7c6be224944739bcf3331bfe4563c, user_id=2f5597cbb4db4e02991825479c0534be, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.097309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.170820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1279/2574] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:17 2022] PUT /identity/v3/projects/34d7c6be224944739bcf3331bfe4563c/users/2f5597cbb4db4e02991825479c0534be/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:17.176458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.192619 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda2574-0dd1-437f-8541-e7b938b380e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.311227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.312014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.318970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.318970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.318970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.318970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b6be-2335-4857-b453-3edc7958cbb5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.334255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1296/2575] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:17.336895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.361042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1811df-427a-4d2a-b716-b3b27c0a3dd7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.373392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:17.375248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.375956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.376232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.376507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] PATH_INFO: `/v3/projects/34d7c6be224944739bcf3331bfe4563c/users/2f5597cbb4db4e02991825479c0534be/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.385021 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d7c6be224944739bcf3331bfe4563c, user_id=2f5597cbb4db4e02991825479c0534be, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.387771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cc9e-ad8a-458b-8baa-74753f041e95 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.406055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1280/2576] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:17 2022] PUT /identity/v3/projects/34d7c6be224944739bcf3331bfe4563c/users/2f5597cbb4db4e02991825479c0534be/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:17.417148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.417434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.417714 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.437357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.437817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.438236 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.456598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] MFA Rules not processed for user `2f5597cbb4db4e02991825479c0534be`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:17.458689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:17.482938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] MFA Rules not processed for user `f17178cb25424167a1e55d5a3692461b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:17.485001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:17.547512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1297/2577] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:17.560587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.562589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:17.585742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1281/2578] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:17.591034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.598033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:17.633575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d63e9-b7c7-4779-bbf4-cb46ae19788b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.638107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.638849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.639208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.639550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.650175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.651687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.662590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1298/2579] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:17.692275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97eaa-2150-43d9-8ebf-2926e0ae8509 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.696479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.697131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.697488 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.697775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.698456 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.701194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.811453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1282/2580] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:17 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:17.815516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.835216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76909079-a4aa-47f1-90c9-483dae0d2f08 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.870860 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:17.873833 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:17.934182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.934937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.935309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.935644 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.936410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.938887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:17.959333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b94d7-24f3-42a5-9692-2963e5d6e38f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:17.964267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:17.965168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:17.965861 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:17.966358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] PATH_INFO: `/v3/users/df67bf1d4e3a4aed8630d610a2ab9abe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:17.969431 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df67bf1d4e3a4aed8630d610a2ab9abe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:17.971678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.093308 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1299/2581] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:17 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:18.097210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:18.107752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614482-0eca-4b7c-8b6d-bcfcb53be91d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:18.114526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:18.115068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.115353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.115633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.116332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:18.118007 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.128266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1300/2582] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:18.132743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:18.142510 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb6307-8295-4e6c-856f-cf333e0fabd6 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:18.148219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:18.148930 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.149215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.149493 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] PATH_INFO: `/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53/users/0af0800bf4854d3ba93bd6ff9f70f67b/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.164609 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbeab67fbfd84644b7d7f8b86477dc53, user_id=0af0800bf4854d3ba93bd6ff9f70f67b, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:18.167374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.218004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df67bf1d4e3a4aed8630d610a2ab9abe'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:18.218658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df67bf1d4e3a4aed8630d610a2ab9abe'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:18.225748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df67bf1d4e3a4aed8630d610a2ab9abe'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:18.237789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df67bf1d4e3a4aed8630d610a2ab9abe'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:18.238166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1301/2583] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:18 2022] PUT /identity/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53/users/0af0800bf4854d3ba93bd6ff9f70f67b/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:18.242059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:18.307593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7287323-79a8-43f3-9997-924815400360 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:18.312576 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:18.313322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.313664 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.313997 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.314697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:18.316334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.330848 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1302/2584] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:18.331651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:18.342266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea33af-2223-4936-b9c7-fc462595b84a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:18.346799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-43fa66dc-2489-4ea2-93ba-e46db3f5ef88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df67bf1d4e3a4aed8630d610a2ab9abe'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:18.347307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:18.347991 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.348274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.348546 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] PATH_INFO: `/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53/users/0af0800bf4854d3ba93bd6ff9f70f67b/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.350513 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbeab67fbfd84644b7d7f8b86477dc53, user_id=0af0800bf4854d3ba93bd6ff9f70f67b, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:18.353259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.367681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1283/2585] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:17 2022] DELETE /identity/v3/users/df67bf1d4e3a4aed8630d610a2ab9abe => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:18.367802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1303/2586] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:18 2022] PUT /identity/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53/users/0af0800bf4854d3ba93bd6ff9f70f67b/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:18.370922 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.371215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.371495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.393110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:18.396558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:18.455572 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1284/2587] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:18.466063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:18.468082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:18.678449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8f29c-a1be-4a56-b645-f2b5b03fb909 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:18.682937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:18.683554 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:18.694752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:18.694752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:18.710203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:18.712539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:18.726684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:18.727206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1304/2588] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:19.044566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:19.293492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:19.296407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:19.324296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404fbca-252d-4fc3-bc7d-148f67bd6618 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:19.342305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:19.344334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:19.344801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:19.346035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] PATH_INFO: `/v3/projects/8c6070505a93488c984bf118cb6de436` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:19.350159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6070505a93488c984bf118cb6de436)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:19.353182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:19.500632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6070505a93488c984bf118cb6de436', 'request_id': 'req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.507924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6070505a93488c984bf118cb6de436', 'request_id': 'req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.522066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6070505a93488c984bf118cb6de436', 'request_id': 'req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.590666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:19.628907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] The token cache is being invalidate because project 8c6070505a93488c984bf118cb6de436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:19.629392 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.630321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.632748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1285/2589] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:19 2022] DELETE /identity/v3/projects/8c6070505a93488c984bf118cb6de436 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:19.636307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:19.646815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5ca0-5973-4df9-ad52-414fc504f938 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:19.709039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:19.709683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:19.710082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:19.710556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] PATH_INFO: `/v3/users/2f5597cbb4db4e02991825479c0534be` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:19.711910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5597cbb4db4e02991825479c0534be)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:19.713844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:19.897362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5597cbb4db4e02991825479c0534be'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.898097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5597cbb4db4e02991825479c0534be'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.898980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5597cbb4db4e02991825479c0534be'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:19.912995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5597cbb4db4e02991825479c0534be'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:20.032670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5597cbb4db4e02991825479c0534be'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:20.046242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1305/2590] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:19 2022] DELETE /identity/v3/users/2f5597cbb4db4e02991825479c0534be => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:20.362164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:20.363746 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:20.440895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:20.499901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab6efe-b3bd-47f6-bb4a-6b9c084f487d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:20.665620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:20.666801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:20.667084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:20.667534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:20.669419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:20.763404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:20.764771 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83ccfd-71cf-4f18-85b9-8264c57a82ec service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:20.778437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1286/2591] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:20.835374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:20.840235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:20.980702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:20.985478 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58552369-ee02-4568-bcd1-5354d66c06e9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:20.991283 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:20.995167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:20.995845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:20.996634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] PATH_INFO: `/v3/projects/34d7c6be224944739bcf3331bfe4563c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:20.998227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d7c6be224944739bcf3331bfe4563c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:21.000504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:21.207939 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d7c6be224944739bcf3331bfe4563c', 'request_id': 'req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:21.229222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d7c6be224944739bcf3331bfe4563c', 'request_id': 'req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:21.302306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d7c6be224944739bcf3331bfe4563c', 'request_id': 'req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:21.328387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] The token cache is being invalidate because project 34d7c6be224944739bcf3331bfe4563c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:21.328387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:21.328387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-2f4c2e17-2bce-4726-9e8b-fcb352cdc546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:21.328817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1306/2592] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:20 2022] DELETE /identity/v3/projects/34d7c6be224944739bcf3331bfe4563c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:21.334178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:21.334477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:21.334779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:21.360163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:21.361707 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:21.446441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1287/2593] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:21.459160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:21.459160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:21.459160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:21.476564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:21.477902 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:21.492080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:21.495314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1307/2594] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:21.502534 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888cbb-b5d5-4a02-8f22-950131dce1bb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:21.507643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:21.508269 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:21.508546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:21.508815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:21.509511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:21.509808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:21.511566 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:21.527924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1288/2595] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:21.531035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:21.542261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e2777-33fb-47e1-aaf9-4f841aa84cc4 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:21.552760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:21.553881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:21.554449 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:21.554998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:21.563254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:21.565699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:21.696167 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1308/2596] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:21 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:21.705173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:21.723493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081eef-4067-4719-a51d-83a2ab5ad7a7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:21.854520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:21.855490 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:21.855962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:21.856651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:21.857503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:21.860139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.006373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1289/2597] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:21 2022] POST /identity/v3/users => generated 304 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:22.010267 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.027210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6acf5-6d34-4278-ba3d-e9729243469b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.032255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.032879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.033155 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.033423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.034116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.036762 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.047458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1309/2598] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:22.052379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.063826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6050f-60dd-44d7-b125-5aa7def3adae admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.089909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.090560 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.090892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.091137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.092074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.093714 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ebaf6-0155-4125-b1ba-b12502402b33 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.115128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1290/2599] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:22.119053 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.146016 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea8628-a79f-46f2-937a-5a940f464764 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.155829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.157838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.157838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.157838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] PATH_INFO: `/v3/projects/de695a95b5b24957ba9e7a37c7fc9f6f/users/80e7c357d63a4db4b2fdba5e943f3fe7/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.176750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de695a95b5b24957ba9e7a37c7fc9f6f, user_id=80e7c357d63a4db4b2fdba5e943f3fe7, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.179743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.204747 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:22.280471 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1310/2600] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:22 2022] PUT /identity/v3/projects/de695a95b5b24957ba9e7a37c7fc9f6f/users/80e7c357d63a4db4b2fdba5e943f3fe7/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:22.291601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.291887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.292167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.328356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] MFA Rules not processed for user `80e7c357d63a4db4b2fdba5e943f3fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:22.329513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:22.427967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1291/2601] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:22.432423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.511588 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58641952-8e5c-4fa4-adc4-ec121dd484e0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.518734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.520217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.520441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.520721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.522001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.524245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.649525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1311/2602] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:22 2022] POST /identity/v3/projects => generated 407 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:22.650740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.662938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749a80b-d82a-4b0b-acbe-5313d5b1a272 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.744400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.744400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.744400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.744400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.744799 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.746631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.884237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1292/2603] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:22 2022] POST /identity/v3/users => generated 310 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:22.885807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.898208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9f43-32c8-4f76-b064-1661a61d97b1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.903952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.903952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.904355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.904794 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.906192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.908085 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.911574 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:22.923992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1312/2604] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:22.925564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:22.942239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd63bc4-da9d-4ea3-a689-5a614f296fbc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:22.949055 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:22.950028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:22.950459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:22.950951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] PATH_INFO: `/v3/projects/3ee6961ccf60461585aa11f538736e1d/users/8018ae1092d948c889d4ced1b6d2d6e2/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:22.969416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee6961ccf60461585aa11f538736e1d, user_id=8018ae1092d948c889d4ced1b6d2d6e2, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:22.974533 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:22.980589 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:23.056615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1293/2605] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:22 2022] PUT /identity/v3/projects/3ee6961ccf60461585aa11f538736e1d/users/8018ae1092d948c889d4ced1b6d2d6e2/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:23.060428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:23.070479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523146b4-6ad3-4ea4-81c3-73d874f51741 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:23.154677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:23.154677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:23.154677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:23.154677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:23.155332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:23.155332 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cbf26-f513-4a26-a15b-ae51261f3213 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:23.172018 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1313/2606] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:23.175369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:23.189019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b44f7-7873-4e8d-bf44-7c8c47c9e657 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:23.197705 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:23.198495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:23.198886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:23.199277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] PATH_INFO: `/v3/projects/3ee6961ccf60461585aa11f538736e1d/users/8018ae1092d948c889d4ced1b6d2d6e2/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:23.201362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee6961ccf60461585aa11f538736e1d, user_id=8018ae1092d948c889d4ced1b6d2d6e2, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:23.204607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:23.218360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1294/2607] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:23 2022] PUT /identity/v3/projects/3ee6961ccf60461585aa11f538736e1d/users/8018ae1092d948c889d4ced1b6d2d6e2/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:23.228719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:23.229003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:23.229276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:23.260392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] MFA Rules not processed for user `8018ae1092d948c889d4ced1b6d2d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:23.261729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:23.342696 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1314/2608] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:23.354244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:23.355992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:23.423536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77528-6b18-4643-b2e1-60a49fcdc180 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:23.427709 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:23.428349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:23.431543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:23.431543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:23.440060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:23.442147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671143f-0306-4a58-a298-045b075d23cc service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:23.454549 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1295/2609] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:23 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:23.872012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:23.887970 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b901f8-af33-493c-b1d3-ff1fbb9e744b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:23.895633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:23.897017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:23.897399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:23.897742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:23.998738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:24.000216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:24.009911 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1315/2610] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:23 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:26.432297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322175b-c510-4e6c-a8f8-859a143c9303 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:26.432785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322175b-c510-4e6c-a8f8-859a143c9303 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:26.432885 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322175b-c510-4e6c-a8f8-859a143c9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:26.478787 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1322175b-c510-4e6c-a8f8-859a143c9303 None None] MFA Rules not processed for user `0af0800bf4854d3ba93bd6ff9f70f67b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:26.480064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1322175b-c510-4e6c-a8f8-859a143c9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:26.593559 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1296/2611] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:26.608259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:26.609291 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:26.648166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:26.728558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb1f16-3b1e-4652-967f-d5f4152cfae3 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:26.736458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:26.737186 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:26.737538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:26.737886 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:26.740906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:26.813497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:26.815424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:26.826853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1316/2612] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:29.973966 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:29.974539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:29.974539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:29.994740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] MFA Rules not processed for user `f17178cb25424167a1e55d5a3692461b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:29.999326 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:30.004313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1297/2613] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:31.593607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:31.597099 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:31.599109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:31.684669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e8c4f-7fbf-48a1-9760-fe451c290cce service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:31.687689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf618a-c0cf-4958-be24-a0ee52b30c96 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:31.689553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:31.690198 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:31.690649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:31.691077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] PATH_INFO: `/v3/users/80e7c357d63a4db4b2fdba5e943f3fe7` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:31.691610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:31.692237 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e7c357d63a4db4b2fdba5e943f3fe7)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:31.692436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:31.692911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:31.693325 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:31.694454 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:31.695303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:31.713215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:31.714831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066ef33-f96c-402f-84be-461e8ba2a590 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:31.726913 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1298/2614] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:31.942947 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e7c357d63a4db4b2fdba5e943f3fe7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:31.943617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e7c357d63a4db4b2fdba5e943f3fe7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:31.957640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e7c357d63a4db4b2fdba5e943f3fe7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:31.957640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:31.957640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e7c357d63a4db4b2fdba5e943f3fe7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:32.032256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e7c357d63a4db4b2fdba5e943f3fe7'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:32.047457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1317/2615] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:31 2022] DELETE /identity/v3/users/80e7c357d63a4db4b2fdba5e943f3fe7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:32.051994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:32.052334 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:32.052651 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:32.070951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:32.077050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:32.078274 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:32.139321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1299/2616] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:32.150025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:32.151486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:32.214061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903a87-ce9f-4fd0-bea0-b4f3223455a3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:32.217685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:32.218297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:32.222182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:32.222182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:32.228497 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:32.229958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:32.239538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1318/2617] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:32.859198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:32.860733 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:32.876954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa9b28-1c02-4b74-bc25-819d0b9a4be3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:32.883876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:32.885357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:32.885926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:32.886419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] PATH_INFO: `/v3/projects/de695a95b5b24957ba9e7a37c7fc9f6f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:32.889819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de695a95b5b24957ba9e7a37c7fc9f6f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:32.901719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:33.060837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de695a95b5b24957ba9e7a37c7fc9f6f', 'request_id': 'req-f2c83bbc-e7c6-4337-8320-ff26f8483524'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.083498 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de695a95b5b24957ba9e7a37c7fc9f6f', 'request_id': 'req-f2c83bbc-e7c6-4337-8320-ff26f8483524'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.092060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de695a95b5b24957ba9e7a37c7fc9f6f', 'request_id': 'req-f2c83bbc-e7c6-4337-8320-ff26f8483524'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.190659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] The token cache is being invalidate because project de695a95b5b24957ba9e7a37c7fc9f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:33.196620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.196620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.196620 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1300/2618] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:32 2022] DELETE /identity/v3/projects/de695a95b5b24957ba9e7a37c7fc9f6f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:33.198874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:33.209699 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf2ae-24b5-44fc-a58c-c8bcd3119a50 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:33.269605 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:33.271503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:33.271981 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:33.272255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] PATH_INFO: `/v3/users/8018ae1092d948c889d4ced1b6d2d6e2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:33.273452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8018ae1092d948c889d4ced1b6d2d6e2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:33.275423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:33.504299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8018ae1092d948c889d4ced1b6d2d6e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.505564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8018ae1092d948c889d4ced1b6d2d6e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.506395 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8018ae1092d948c889d4ced1b6d2d6e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.519214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8018ae1092d948c889d4ced1b6d2d6e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.592529 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-5ab39e19-8b8d-4453-ac61-fb1afcbd625d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8018ae1092d948c889d4ced1b6d2d6e2'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:33.600106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:33.610147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1319/2619] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:33 2022] DELETE /identity/v3/users/8018ae1092d948c889d4ced1b6d2d6e2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:34.118590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:34.120583 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:34.157375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83bbc-e7c6-4337-8320-ff26f8483524 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:34.228479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:34.229910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.230478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.231221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] PATH_INFO: `/v3/projects/3ee6961ccf60461585aa11f538736e1d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:34.235026 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee6961ccf60461585aa11f538736e1d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:34.237907 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:34.361950 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:34.380793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee6961ccf60461585aa11f538736e1d', 'request_id': 'req-d5663218-d35b-43ba-8d8a-491ad108014a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:34.387836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee6961ccf60461585aa11f538736e1d', 'request_id': 'req-d5663218-d35b-43ba-8d8a-491ad108014a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:34.393876 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee6961ccf60461585aa11f538736e1d', 'request_id': 'req-d5663218-d35b-43ba-8d8a-491ad108014a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:34.521072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] The token cache is being invalidate because project 3ee6961ccf60461585aa11f538736e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:34.521539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:34.522078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d5663218-d35b-43ba-8d8a-491ad108014a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:34.523679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1301/2620] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:34 2022] DELETE /identity/v3/projects/3ee6961ccf60461585aa11f538736e1d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:34.532547 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.533055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.533139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:34.562093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:34.563348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:34.635235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1320/2621] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:34.644206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.644501 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.644786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:34.666750 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:34.667999 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:34.676104 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1302/2622] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:34.681209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:34.702272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a042c1b-1416-48b0-b35b-ef6288e8161b None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:34.707536 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:34.720084 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:34.724556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1321/2623] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:34.729289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:34.739241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7d83-8cef-4529-a30a-2859b86d1113 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:34.745151 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:34.745780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.746064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.746340 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:34.747051 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:34.748986 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:34.880571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1303/2624] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:34 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:34.884894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:34.902196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243d340-1c1c-490b-b3f7-54036648f662 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:34.998560 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:34.998704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:34.998978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:34.999417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.000108 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.002166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.166866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.167346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1322/2625] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:34 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:35.179660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38950a17-0352-4190-a41f-a3966d908721 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.187646 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.188279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.188561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.188854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.189704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.191341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.203902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1304/2626] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:35.208667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.221026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd2676-b0f3-44b0-a6b5-2d6555afb653 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.226526 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.227235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.227516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.227793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.228528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.230124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337135ef-a9d6-463e-aaff-53ee29bd5322 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.244061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1323/2627] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:35.246451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.260976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11477ed-64fa-4e63-98a2-1d31d170c199 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.266958 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.267687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.268903 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.270147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] PATH_INFO: `/v3/projects/0a97dae2127c4c358d927f838af34e6c/users/0e3057679bc04f4b98f40116c6da958b/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.297064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a97dae2127c4c358d927f838af34e6c, user_id=0e3057679bc04f4b98f40116c6da958b, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.302475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.384610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1305/2628] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:35 2022] PUT /identity/v3/projects/0a97dae2127c4c358d927f838af34e6c/users/0e3057679bc04f4b98f40116c6da958b/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:35.443381 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.443671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.443950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.462668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.466762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:35.474230 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] MFA Rules not processed for user `0e3057679bc04f4b98f40116c6da958b`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:35.475665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:35.534511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:35.553116 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1324/2629] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:35.554821 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619f16-d6b5-4ccb-ba17-ad2ff237a3e8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.557480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.560633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.561526 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.561819 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.562115 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.564500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:35.578329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.580047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.592328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1306/2630] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:35.593264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.600866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:35.640125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086dfde-8784-4931-b70b-7a4c955bda3e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.645069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.646509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.646836 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.647014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.647671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.649575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.658591 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:35.676027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462f04c-fc00-4569-af42-97c1555b462f service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.681028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.681671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.681956 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.682264 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] PATH_INFO: `/v3/users/bc8e587cb33a47c7921466f65933401c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.683609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8e587cb33a47c7921466f65933401c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.685597 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.780247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1325/2631] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:35 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:35.783940 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.847557 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c29b-94bd-4c9b-b130-545b4f723eb9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.852635 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.853579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.853579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.853780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.854433 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.856430 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.916277 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8e587cb33a47c7921466f65933401c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:35.916964 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8e587cb33a47c7921466f65933401c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:35.923963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8e587cb33a47c7921466f65933401c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:35.938031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8e587cb33a47c7921466f65933401c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:35.940883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1326/2632] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:35 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:35.944607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.954582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e016-65b8-4652-b18f-4e7dfed32639 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.960746 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.961344 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.961620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.962113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:35.963482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:35.965840 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:35.978809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1327/2633] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:35.982871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:35.993479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e96524-52e2-448d-a53d-a89d3f0b4dd5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:35.998160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:35.998828 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:35.999107 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:35.999378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] PATH_INFO: `/v3/projects/a786198dee9841c59e35ffc637a664e2/users/4f665df9558d4a058af4984b3a6a40c9/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.012800 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8e587cb33a47c7921466f65933401c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.014407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a786198dee9841c59e35ffc637a664e2, user_id=4f665df9558d4a058af4984b3a6a40c9, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.017593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.019931 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1307/2634] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:35 2022] DELETE /identity/v3/users/bc8e587cb33a47c7921466f65933401c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:36.135585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1328/2635] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:35 2022] PUT /identity/v3/projects/a786198dee9841c59e35ffc637a664e2/users/4f665df9558d4a058af4984b3a6a40c9/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:36.139871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.141398 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.221110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2cbc3-13d9-4763-900d-29b0c5dbe0ce admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.266925 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.268307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.290568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.291069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.291353 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.291681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.292487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.294344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.307482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1308/2636] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:36.311382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.323729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:36.324054 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f516b3-af9b-4ebb-a307-6ed0e57f0817 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.330198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.330751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.331036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.331316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] PATH_INFO: `/v3/projects/a786198dee9841c59e35ffc637a664e2/users/4f665df9558d4a058af4984b3a6a40c9/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.335801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a786198dee9841c59e35ffc637a664e2, user_id=4f665df9558d4a058af4984b3a6a40c9, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.337491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61876b-e1a7-4dd7-b803-d08a0ebb7ce4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.341041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:36.349194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1309/2637] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:36 2022] PUT /identity/v3/projects/a786198dee9841c59e35ffc637a664e2/users/4f665df9558d4a058af4984b3a6a40c9/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:36.358774 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727f77a-1650-4753-8c59-68d9fca164c4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.359603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.360022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.360303 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.392008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] MFA Rules not processed for user `4f665df9558d4a058af4984b3a6a40c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:36.393427 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.423213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.423899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.424313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.424593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] PATH_INFO: `/v3/projects/fe97ce3d979e410ca15529475d4c342e` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.425801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe97ce3d979e410ca15529475d4c342e)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.429920 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.466892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1310/2638] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:36.478403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.479877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.538438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d347f-e9e2-41bf-8766-54ad1eae5302 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.542636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.543296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.543571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.543953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.554310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.555955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0e40e-933d-42a4-9098-712bea5f378d service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.557374 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe97ce3d979e410ca15529475d4c342e', 'request_id': 'req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.563824 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe97ce3d979e410ca15529475d4c342e', 'request_id': 'req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.565593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1311/2639] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:36.623983 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe97ce3d979e410ca15529475d4c342e', 'request_id': 'req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.648193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] The token cache is being invalidate because project fe97ce3d979e410ca15529475d4c342e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:36.648515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.649203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9814b46b-c03b-4d7a-95a2-ce5eee005c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:36.650782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1329/2640] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:36 2022] DELETE /identity/v3/projects/fe97ce3d979e410ca15529475d4c342e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:36.656399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.656719 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.657053 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.678754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:36.680014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.755084 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1312/2641] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:36.764217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.764563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.764835 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.786373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:36.788243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:36.799563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1330/2642] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:36.805985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.816267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c7791-3170-46a0-a23f-4629aa829fce None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.821507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.822116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.822394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.822839 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.823627 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:36.823837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.825453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.839510 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1313/2643] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:36.842992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.853385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac26b-bd29-45b9-b0d7-75c34e477209 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.858469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:36.859149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:36.859426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:36.859722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:36.860394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:36.862284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:36.960677 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1331/2644] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:36 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:36.961829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:36.974911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7fcc-d563-4c11-a3c7-9373fc962043 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:36.983823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:37.033342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.033955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.034233 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.034508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.035198 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.037633 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.130990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.132913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:37.148845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1314/2645] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:36 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:37.149871 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc06df-23b9-44ca-90b8-9c8c3d668063 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.151542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.155293 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.156021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.156366 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.156855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] PATH_INFO: `/v3/users/0e3057679bc04f4b98f40116c6da958b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.158147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3057679bc04f4b98f40116c6da958b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.160231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.161670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eed9ea-b0c8-49ac-a20f-7cdbdd9508d5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.167043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.167697 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.167987 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.168678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.169370 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.170989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.182449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1315/2646] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:37.191360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.203752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c272588-0b67-4b84-b447-cd70ee47534b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.208993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.209639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.209925 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.210205 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.211001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.212632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.223419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1316/2647] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:37.227793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.248924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91813b-20a2-4411-86c7-d10b9f4ab728 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.248924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.248924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.248924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.249304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] PATH_INFO: `/v3/projects/545fb71baffa467c8c7e1b90a83d2721/users/e7b2dc991a9d483db95e744afe0025f4/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.259360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545fb71baffa467c8c7e1b90a83d2721, user_id=e7b2dc991a9d483db95e744afe0025f4, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.262010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e033ff7-e4b6-4de9-b6cd-47c18ae851c9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.332245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:37.342659 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3057679bc04f4b98f40116c6da958b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:37.343313 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3057679bc04f4b98f40116c6da958b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:37.345806 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3057679bc04f4b98f40116c6da958b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:37.350831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1317/2648] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:37 2022] PUT /identity/v3/projects/545fb71baffa467c8c7e1b90a83d2721/users/e7b2dc991a9d483db95e744afe0025f4/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:37.358216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3057679bc04f4b98f40116c6da958b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:37.361133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.361417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.361698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.393045 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] MFA Rules not processed for user `e7b2dc991a9d483db95e744afe0025f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:37.394327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:37.432213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-87391091-32dc-4e2f-a929-5535f47b7282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3057679bc04f4b98f40116c6da958b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:37.445523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1332/2649] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:37 2022] DELETE /identity/v3/users/0e3057679bc04f4b98f40116c6da958b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:37.449707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.450012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.450264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.473357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1318/2650] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:37.477393 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:37.478744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:37.483691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.485213 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:37.559151 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1333/2651] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:37.569337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:37.571049 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:37.638617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93fdcf-7bc4-40a1-87b8-cfd46d741937 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.642988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.643617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.643921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.644166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.655192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.656716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.668566 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1334/2652] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:37.678391 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:37.715641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8b4a-caf8-4bde-90d3-648705d3d85b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:37.778889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:37.779512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:37.779789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:37.780058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:37.839743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:37.841487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:37.851718 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1319/2653] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:38.166146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:38.168182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:38.206538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe55d-acd6-4d44-a042-ca10f7d98f13 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:38.221124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:38.223870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:38.224427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:38.225420 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] PATH_INFO: `/v3/projects/0a97dae2127c4c358d927f838af34e6c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:38.227518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a97dae2127c4c358d927f838af34e6c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:38.229800 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:38.308285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:38.309434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:38.328582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc5d75-fec0-4643-b8bb-4b0318f1554c service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:38.333317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:38.334820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:38.335107 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:38.335582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] PATH_INFO: `/v3/users/e7b2dc991a9d483db95e744afe0025f4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:38.337076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b2dc991a9d483db95e744afe0025f4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:38.339346 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:38.386081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a97dae2127c4c358d927f838af34e6c', 'request_id': 'req-386502df-734b-40b4-a020-53c53a799d29'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.387303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:38.392065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a97dae2127c4c358d927f838af34e6c', 'request_id': 'req-386502df-734b-40b4-a020-53c53a799d29'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.515343 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a97dae2127c4c358d927f838af34e6c', 'request_id': 'req-386502df-734b-40b4-a020-53c53a799d29'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.527523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] The token cache is being invalidate because project 0a97dae2127c4c358d927f838af34e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:38.527809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.528426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.529918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1335/2654] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:38 2022] DELETE /identity/v3/projects/0a97dae2127c4c358d927f838af34e6c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:38.533820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:38.535523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:38.560613 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b2dc991a9d483db95e744afe0025f4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.561298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b2dc991a9d483db95e744afe0025f4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.569069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b2dc991a9d483db95e744afe0025f4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.581059 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b2dc991a9d483db95e744afe0025f4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.582699 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:38.608590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386502df-734b-40b4-a020-53c53a799d29 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:38.613263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:38.613896 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:38.614169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:38.616648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] PATH_INFO: `/v3/users/4f665df9558d4a058af4984b3a6a40c9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:38.616648 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f665df9558d4a058af4984b3a6a40c9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:38.618272 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:38.660764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8b395845-f606-4424-bc84-2dbc0e1f0626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b2dc991a9d483db95e744afe0025f4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.667706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1320/2655] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:38 2022] DELETE /identity/v3/users/e7b2dc991a9d483db95e744afe0025f4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:38.671935 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:38.672214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:38.672486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:38.690877 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:38.692161 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:38.755118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1321/2656] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:38.764677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:38.766031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:38.822842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cbbc-5113-427d-94b5-ce0ab67a3f7d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:38.826558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:38.827207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:38.827486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:38.827761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:38.838008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:38.839512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:38.847244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f665df9558d4a058af4984b3a6a40c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.847880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f665df9558d4a058af4984b3a6a40c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.848487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f665df9558d4a058af4984b3a6a40c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:38.849136 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1322/2657] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:38.861464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f665df9558d4a058af4984b3a6a40c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.050077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f665df9558d4a058af4984b3a6a40c9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.066224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1336/2658] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:38 2022] DELETE /identity/v3/users/4f665df9558d4a058af4984b3a6a40c9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:39.551668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:39.554963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:39.567619 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08224d31-98b5-4379-8d5b-8a3b7e44cd1c service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:39.586938 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:39.588707 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:39.642647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:39.645127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:39.645127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:39.645127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] PATH_INFO: `/v3/projects/545fb71baffa467c8c7e1b90a83d2721` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:39.645127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=545fb71baffa467c8c7e1b90a83d2721)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:39.647285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:39.657375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:39.660977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa19a4-14a8-488e-b561-9a5b9c28a7e2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:39.667264 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:39.668380 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:39.668866 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:39.669346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] PATH_INFO: `/v3/projects/a786198dee9841c59e35ffc637a664e2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:39.670862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a786198dee9841c59e35ffc637a664e2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:39.672780 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:39.747077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=1,keystone:DELETE=4,keystone:SELECT=95 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:39.755341 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545fb71baffa467c8c7e1b90a83d2721', 'request_id': 'req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.762626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545fb71baffa467c8c7e1b90a83d2721', 'request_id': 'req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.768400 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545fb71baffa467c8c7e1b90a83d2721', 'request_id': 'req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.780879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a786198dee9841c59e35ffc637a664e2', 'request_id': 'req-1dde8a7f-61d6-467d-9312-9b32feea3392'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.786419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a786198dee9841c59e35ffc637a664e2', 'request_id': 'req-1dde8a7f-61d6-467d-9312-9b32feea3392'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.843494 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] The token cache is being invalidate because project 545fb71baffa467c8c7e1b90a83d2721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:39.843780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.844394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-04e1c8be-ac75-4e0b-812b-7606ed89c4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.845955 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1323/2659] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:39 2022] DELETE /identity/v3/projects/545fb71baffa467c8c7e1b90a83d2721 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:39.850694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbade1b-57df-4b73-aad9-92124f3a7d16 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:39.851503 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbade1b-57df-4b73-aad9-92124f3a7d16 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:39.851770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbade1b-57df-4b73-aad9-92124f3a7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:39.871162 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1cbade1b-57df-4b73-aad9-92124f3a7d16 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:39.872359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1cbade1b-57df-4b73-aad9-92124f3a7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:39.884106 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a786198dee9841c59e35ffc637a664e2', 'request_id': 'req-1dde8a7f-61d6-467d-9312-9b32feea3392'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.896490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] The token cache is being invalidate because project a786198dee9841c59e35ffc637a664e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:39.896781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.897538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-1dde8a7f-61d6-467d-9312-9b32feea3392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:39.899255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1337/2660] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:39 2022] DELETE /identity/v3/projects/a786198dee9841c59e35ffc637a664e2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:39.903910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24464-30ad-44c0-b09e-070776ed2013 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:39.904201 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24464-30ad-44c0-b09e-070776ed2013 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:39.904482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24464-30ad-44c0-b09e-070776ed2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:39.925520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-74f24464-30ad-44c0-b09e-070776ed2013 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:39.926757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74f24464-30ad-44c0-b09e-070776ed2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:39.936497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1324/2661] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:39.945318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:39.945822 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:39.945946 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:39.968082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:39.969298 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:39.978954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1325/2662] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:39.983318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:39.992841 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1338/2663] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:39.993122 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e5d3e-b983-4c78-b0d2-796158721e2c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:39.998006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:39.998623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.002809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.002809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.002809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:40.002809 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.003205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.003319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.003421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.003421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.017889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1326/2664] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:40.019626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.025491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:40.025491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:40.032851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1339/2665] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:40.034801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa236-88b8-4e62-bef4-ade46d3b2355 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.037182 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.040290 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.040899 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.041176 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.041448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.042133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.044074 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.047081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e127f-74fd-45dc-a5f7-87c036d7f668 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.051957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.069830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.070438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1340/2666] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:40.072878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.082163 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1296f38-5604-477e-ba7d-b981481f108c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.087388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.087950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.088227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.088498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.089138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.091139 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.145603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1327/2667] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:40.150545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.184544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1341/2668] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:40.185564 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.220723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95f11f-0462-475e-be3a-2970efdb8d03 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.243810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:40.259767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5345-9da6-470e-b936-3b83fa5f85ae admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.265850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:40.266961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.267598 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.267873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.268141 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.268805 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.270741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.297450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.298068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.298350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.298625 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.299336 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.301293 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.375618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1342/2669] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:40.379645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.390356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91e2b2-0a17-4f30-be53-c27a52467fd4 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.400490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.400490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.400490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.400490 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.401300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.402870 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1328/2670] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/users => generated 303 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:40.403457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.403704 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.414554 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3888880-4142-4c66-bf55-b8dc4865bcd8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.415187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1343/2671] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:40.419978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.421164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.421797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.422214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.422500 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.426413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.426413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.436346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9580-5c16-4399-916f-6a743ec2178d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.438836 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1329/2672] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:40.443242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.444239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.445268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.445743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.446649 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.452214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.452214 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.454884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f15f-304d-4f1f-ab94-9c37ca20f2ea admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.460755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.461679 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.461970 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.462270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.463008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.464608 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.466082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1344/2673] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:40.469950 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.491224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1330/2674] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:40.491224 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.496401 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591292d-4e43-455c-b0e2-940f6f1bf912 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.501542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4043-4788-43e2-a891-db97b4454dbb admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.504030 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.504704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.504980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.505251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] PATH_INFO: `/v3/projects/d7ef4594810d4ac28ee04f91194a327c/users/cd7f90be85d64303b0de528c173b64e6/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.506685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.507984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.508396 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.508749 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] PATH_INFO: `/v3/projects/083d4e5b961549d0a47245f20ac160fe/users/53b3dda4fcdf4009a89828eb1ddc530d/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.525152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ef4594810d4ac28ee04f91194a327c, user_id=cd7f90be85d64303b0de528c173b64e6, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.526407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083d4e5b961549d0a47245f20ac160fe, user_id=53b3dda4fcdf4009a89828eb1ddc530d, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.528059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052f030-9fcc-4118-a10a-2e9af7a8024d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.529063 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090f78b-e3f5-4ece-9d95-04380bea1452 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.621702 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1331/2675] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:40 2022] PUT /identity/v3/projects/083d4e5b961549d0a47245f20ac160fe/users/53b3dda4fcdf4009a89828eb1ddc530d/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:40.622837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1345/2676] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:40 2022] PUT /identity/v3/projects/d7ef4594810d4ac28ee04f91194a327c/users/cd7f90be85d64303b0de528c173b64e6/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:40.635562 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.635770 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.635900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.636006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.636486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.637670 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.670486 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] MFA Rules not processed for user `53b3dda4fcdf4009a89828eb1ddc530d`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:40.671653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:40.674308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] MFA Rules not processed for user `cd7f90be85d64303b0de528c173b64e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:40.675561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:40.758486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1332/2677] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:40.765747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1346/2678] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:40.772413 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.774511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:40.777597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.831856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa90ae-6a50-4d67-8eee-0c31ae7f84c3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.836228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.836842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.837117 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.837442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.844473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95a2fd-02f6-43aa-8cb1-5dda65db7f69 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.849983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.857887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:40.857887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:40.858147 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.858247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:40.858247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:40.858247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:40.858247 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:40.862138 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1333/2679] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:40.974173 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1347/2680] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/projects => generated 403 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:40.979096 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:40.989512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7398f90-55d0-48ae-9337-4f4cc77b8e78 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:40.993550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:41.048166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.048783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.049065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.049345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.050001 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.052042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.183464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1334/2681] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:40 2022] POST /identity/v3/users => generated 308 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:41.187372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.194457 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:41.198543 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0e749-8140-483b-998a-1c2d2e7de1f9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.203360 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.203969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.204246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.204515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.205200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.206818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.217281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1348/2682] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:41.221658 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.233518 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bff64-03e4-4566-9c5c-50a1d629b9de admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.238372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.239114 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.239393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.239701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] PATH_INFO: `/v3/projects/a6640a90856745fe916e05f428d2ba75/users/81e3b03fd3424fcc90564b1f4c0e0b38/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.255448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6640a90856745fe916e05f428d2ba75, user_id=81e3b03fd3424fcc90564b1f4c0e0b38, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.259047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.339508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1335/2683] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:41 2022] PUT /identity/v3/projects/a6640a90856745fe916e05f428d2ba75/users/81e3b03fd3424fcc90564b1f4c0e0b38/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:41.343785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.353870 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b08adc-4e27-4fe2-a4e7-645c9512e8c7 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.412881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.413603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.413899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.414164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.414892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.416542 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5aa5c-fa30-413d-86f0-8f678cc1f4d4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.426382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1349/2684] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:41.430834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.442574 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc41e-cc04-471e-a6ec-ca9b0d9f78df admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.447760 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.448412 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.448693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.448962 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] PATH_INFO: `/v3/projects/a6640a90856745fe916e05f428d2ba75/users/81e3b03fd3424fcc90564b1f4c0e0b38/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.450973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6640a90856745fe916e05f428d2ba75, user_id=81e3b03fd3424fcc90564b1f4c0e0b38, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.453587 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.464120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1336/2685] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:41 2022] PUT /identity/v3/projects/a6640a90856745fe916e05f428d2ba75/users/81e3b03fd3424fcc90564b1f4c0e0b38/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:41.474465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.474801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.475075 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.510111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] MFA Rules not processed for user `81e3b03fd3424fcc90564b1f4c0e0b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:41.511358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:41.594949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1350/2686] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:41.604244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.664365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee6696-b20c-4975-bcd5-e4588a83c18f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.668171 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.668801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.669081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.669358 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.679504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.680980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089d0a8-e10a-4dc1-a911-0c177a98237c service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.696206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1337/2687] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:41.872193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:41.941009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfb286-565b-4104-a35d-53852ef5debd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:41.946429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:41.947181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:41.947491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:41.947767 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] PATH_INFO: `/v3/users/53b3dda4fcdf4009a89828eb1ddc530d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:41.949082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b3dda4fcdf4009a89828eb1ddc530d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:41.951480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:41.971382 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:42.139851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b3dda4fcdf4009a89828eb1ddc530d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:42.144803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b3dda4fcdf4009a89828eb1ddc530d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:42.144803 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b3dda4fcdf4009a89828eb1ddc530d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:42.153516 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b3dda4fcdf4009a89828eb1ddc530d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:42.224087 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b3dda4fcdf4009a89828eb1ddc530d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:42.238523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1351/2688] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:41 2022] DELETE /identity/v3/users/53b3dda4fcdf4009a89828eb1ddc530d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:42.244292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:42.248012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:42.248012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:42.263850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:42.265032 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:42.339565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1338/2689] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:42.347127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:42.348552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:42.406622 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19285b72-eeec-48c5-9484-4458d5a3d365 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:42.410274 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:42.410918 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:42.411200 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:42.411479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:42.422515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:42.423989 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:42.436392 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1352/2690] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:42.885905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:42.888065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:42.894571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:42.901086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64d8f-2cac-4164-b43b-aaa34cbe728f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:42.907087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:42.907844 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:42.915064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:42.915064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] PATH_INFO: `/v3/projects/083d4e5b961549d0a47245f20ac160fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:42.915064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=083d4e5b961549d0a47245f20ac160fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:42.915064 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:43.056818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083d4e5b961549d0a47245f20ac160fe', 'request_id': 'req-2295312f-06f3-46e7-a40e-eace2a439e5e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.062976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083d4e5b961549d0a47245f20ac160fe', 'request_id': 'req-2295312f-06f3-46e7-a40e-eace2a439e5e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.068753 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083d4e5b961549d0a47245f20ac160fe', 'request_id': 'req-2295312f-06f3-46e7-a40e-eace2a439e5e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.114820 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] The token cache is being invalidate because project 083d4e5b961549d0a47245f20ac160fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:43.115108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.115730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.117271 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1339/2691] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:42 2022] DELETE /identity/v3/projects/083d4e5b961549d0a47245f20ac160fe => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:43.121423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:43.131109 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdec57-e1b0-4f8d-b2f4-617e8a501c72 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:43.193210 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:43.193854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:43.194146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:43.194503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] PATH_INFO: `/v3/users/81e3b03fd3424fcc90564b1f4c0e0b38` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:43.195972 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e3b03fd3424fcc90564b1f4c0e0b38)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:43.197892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:43.426472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:43.433165 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e3b03fd3424fcc90564b1f4c0e0b38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.433877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e3b03fd3424fcc90564b1f4c0e0b38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.434496 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e3b03fd3424fcc90564b1f4c0e0b38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.446943 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e3b03fd3424fcc90564b1f4c0e0b38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.532456 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e3b03fd3424fcc90564b1f4c0e0b38'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:43.545697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1353/2692] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:43 2022] DELETE /identity/v3/users/81e3b03fd3424fcc90564b1f4c0e0b38 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:44.031693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.033221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.048893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295312f-06f3-46e7-a40e-eace2a439e5e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.114639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.115310 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.115586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.115856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] PATH_INFO: `/v3/users/cd7f90be85d64303b0de528c173b64e6` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.117686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7f90be85d64303b0de528c173b64e6)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.119831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.199610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.199610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.214035 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09864a1-f715-432f-a71d-984e2850692e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.219298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.219926 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.220213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.220487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] PATH_INFO: `/v3/projects/a6640a90856745fe916e05f428d2ba75` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.221859 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6640a90856745fe916e05f428d2ba75)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.228874 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.363660 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7f90be85d64303b0de528c173b64e6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.364317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7f90be85d64303b0de528c173b64e6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.372071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7f90be85d64303b0de528c173b64e6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.387292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7f90be85d64303b0de528c173b64e6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.394528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6640a90856745fe916e05f428d2ba75', 'request_id': 'req-43c808d7-8df5-464a-ba8b-f68183ee2a5a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.400597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6640a90856745fe916e05f428d2ba75', 'request_id': 'req-43c808d7-8df5-464a-ba8b-f68183ee2a5a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.472067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1a4fcb02-06c1-4dd6-8d95-503ae9e09375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7f90be85d64303b0de528c173b64e6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.477380 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1340/2693] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:44 2022] DELETE /identity/v3/users/cd7f90be85d64303b0de528c173b64e6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:44.481623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.481908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.482180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.490175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:44.502291 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:44.503541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.546563 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6640a90856745fe916e05f428d2ba75', 'request_id': 'req-43c808d7-8df5-464a-ba8b-f68183ee2a5a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.558171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] The token cache is being invalidate because project a6640a90856745fe916e05f428d2ba75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:44.558442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.559096 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-43c808d7-8df5-464a-ba8b-f68183ee2a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:44.560606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1354/2694] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:44 2022] DELETE /identity/v3/projects/a6640a90856745fe916e05f428d2ba75 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:44.563507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1341/2695] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:44.565327 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f05-e9df-4739-9644-2f25d06a42cd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.565607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f05-e9df-4739-9644-2f25d06a42cd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.565880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f05-e9df-4739-9644-2f25d06a42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.573826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.576338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.586518 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bd487f05-e9df-4739-9644-2f25d06a42cd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:44.587739 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bd487f05-e9df-4739-9644-2f25d06a42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.595779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1355/2696] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:44.605855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.607350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.607350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.625957 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:44.627233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.634246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a137ce-e018-4cea-b6e4-6aaa0f5e3dac None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.638742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1356/2697] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:44.638878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.638878 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.639174 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.639457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.639624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.641414 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:44.649679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfd810-a7a0-4b57-b82f-69d6f79f5c2e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.654778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.659808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.659808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.659808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.659808 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:44.660178 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.660266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.660352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.660438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.669132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1342/2698] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:44.673776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1357/2699] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:44.678089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.689406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b123c8-4da5-4845-b2bd-50f3b2d81774 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.702058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.702292 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.702410 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.702668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.703363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.705441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.817016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1343/2700] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:44 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:44.821916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.831810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba122-d344-4a82-9503-23fa1c4e45f5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:44.888690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:44.889115 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:44.889394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:44.889667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:44.890338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:44.892307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:44.990737 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:44.991548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1358/2701] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:44 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:45.002884 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942f627-192e-4439-9bf0-6a44f7fb32b9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.009748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.010489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.010890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.011558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.012184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.014363 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.026766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1344/2702] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:45.030935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.037719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:45.041819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af28192-2513-4e13-b690-397c643286f5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.046662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.047340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.047625 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.047899 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.048624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.050228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.060857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1359/2703] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:45.065223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.076189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a1094-cf60-4a10-ab84-befac6fc0ded admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.081250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.081945 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.082229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.082508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] PATH_INFO: `/v3/projects/b1ca25169aa14bd3a1da5f972207f3eb/users/29325cd28bd7429993c65f6a78704b52/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.098211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ca25169aa14bd3a1da5f972207f3eb, user_id=29325cd28bd7429993c65f6a78704b52, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.101650 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0471-6ceb-44d6-b252-e4bb20b5d9e0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.148324 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.150373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:45.164512 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd515c-5074-4340-8f6a-91c4b7d27faa admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.170777 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.171545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.171697 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.171990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] PATH_INFO: `/v3/projects/d7ef4594810d4ac28ee04f91194a327c` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.173203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ef4594810d4ac28ee04f91194a327c)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.175421 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.175542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1345/2704] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:45 2022] PUT /identity/v3/projects/b1ca25169aa14bd3a1da5f972207f3eb/users/29325cd28bd7429993c65f6a78704b52/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:45.190297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.190674 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.190893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.219871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] MFA Rules not processed for user `29325cd28bd7429993c65f6a78704b52`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:45.221089 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:45.264065 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:45.280463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ef4594810d4ac28ee04f91194a327c', 'request_id': 'req-203f250e-75b9-4625-a477-53c95fa479d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:45.285992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ef4594810d4ac28ee04f91194a327c', 'request_id': 'req-203f250e-75b9-4625-a477-53c95fa479d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:45.292485 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1346/2705] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:45.293527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.355730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40b46-ba43-4ff4-b410-5d56237fc427 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.378025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ef4594810d4ac28ee04f91194a327c', 'request_id': 'req-203f250e-75b9-4625-a477-53c95fa479d1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:45.389992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] The token cache is being invalidate because project d7ef4594810d4ac28ee04f91194a327c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:45.390361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:45.391212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-203f250e-75b9-4625-a477-53c95fa479d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:45.392758 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1360/2706] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:45 2022] DELETE /identity/v3/projects/d7ef4594810d4ac28ee04f91194a327c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:45.398624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df79d-b7bd-4633-8b57-875beeffd802 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.399026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df79d-b7bd-4633-8b57-875beeffd802 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.399306 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df79d-b7bd-4633-8b57-875beeffd802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.417435 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.418052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.418333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.418605 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.419328 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.419515 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-145df79d-b7bd-4633-8b57-875beeffd802 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:45.420721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-145df79d-b7bd-4633-8b57-875beeffd802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:45.421226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.435716 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1361/2707] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:45.437206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.437483 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.437755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.457689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:45.458954 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:45.468177 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1362/2708] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:45.473676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.480594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81118bdb-039a-4018-90b3-457f5e6fdfbd None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.485193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.485783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.486079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.486354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.487077 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:45.487385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.489006 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.500098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1347/2709] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/projects => generated 363 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:45.502788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1363/2710] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:17:45.505436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.505597 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.507734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:45.516669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6906e24-1208-44e3-845b-01186ef692b2 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.581527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.582148 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.582524 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.582832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.583548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.585747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.589313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db68d53-a22b-4a25-a9c9-73c6fb054397 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.594031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.594647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.594982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.595243 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.596133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.598101 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.676852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1364/2711] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:45.681645 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.710314 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1348/2712] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:45.712980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.718124 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:45.722259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:45.722980 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e599-2945-427f-bd5e-433baf788010 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.752791 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e3d87-470d-442a-9a23-f4736b2d6d7d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.758942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.759623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.759849 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.760226 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.760782 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.763079 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.787364 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.787979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.788855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.789335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.790116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.791824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.801541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1349/2713] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:45.806320 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.815632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85d59d-64ce-45fd-9579-2bf01080aff2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.820285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.820911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.821201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.821460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] PATH_INFO: `/v3/projects/c34048c8c9014dc0b42571b9c9919f54/users/f75c2493dd734cc485fec29ac551fac7/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.835797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34048c8c9014dc0b42571b9c9919f54, user_id=f75c2493dd734cc485fec29ac551fac7, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.838403 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.867999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1365/2714] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:45 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:45.870159 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.879209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3949f-2376-4a4f-9a7b-e3495dfc0997 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.884103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.884712 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.884994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.885277 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.885966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.887764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.898994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1366/2715] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:45.902573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.903087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1350/2716] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:45 2022] PUT /identity/v3/projects/c34048c8c9014dc0b42571b9c9919f54/users/f75c2493dd734cc485fec29ac551fac7/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:45.907616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.912842 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff748795-f0ab-4795-8430-b454f5fc99e3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.969262 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995d3a-a6fe-4366-b01d-814506e02f71 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:45.970334 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.971152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.971479 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.971779 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.972464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.974176 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.974302 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:45.974830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:45.975111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:45.975382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:45.976611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:45.978214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:45.984741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1367/2717] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:45.992992 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1351/2718] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:45.993137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.993767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:45.999586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54390b1c-91eb-49b6-b6a9-90a430c0975d admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:46.003984 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a72e-16e3-4c0d-b0b0-5c7b9fd205ac admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:46.004213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:46.004861 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.005140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.005413 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] PATH_INFO: `/v3/projects/e7e1213cd973452f8704bcf696e98a81/users/1c8cf21524db41daa185f432aa442ceb/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.009141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:46.009811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.010087 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.010356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] PATH_INFO: `/v3/projects/c34048c8c9014dc0b42571b9c9919f54/users/f75c2493dd734cc485fec29ac551fac7/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.012362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34048c8c9014dc0b42571b9c9919f54, user_id=f75c2493dd734cc485fec29ac551fac7, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:46.015077 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b9e24-aa61-4983-846c-f465fdc13748 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:46.020348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1213cd973452f8704bcf696e98a81, user_id=1c8cf21524db41daa185f432aa442ceb, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:46.025212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebc1ae-abdb-4b3b-bd51-c50ec52c3021 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:46.026415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1352/2719] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:45 2022] PUT /identity/v3/projects/c34048c8c9014dc0b42571b9c9919f54/users/f75c2493dd734cc485fec29ac551fac7/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:46.036898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.037179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.037453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.065182 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] MFA Rules not processed for user `f75c2493dd734cc485fec29ac551fac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:46.066374 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:46.101389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1368/2720] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:45 2022] PUT /identity/v3/projects/e7e1213cd973452f8704bcf696e98a81/users/1c8cf21524db41daa185f432aa442ceb/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:46.106400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.107245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.107245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.115008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:46.125833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:46.127063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:46.140495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1353/2721] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:46.152570 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:46.155137 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:46.189419 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1369/2722] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:46.201147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:46.208063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:46.217009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395acc75-ea4a-43e8-84bd-aa3f83d9034d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:46.230683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:46.260884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b9a31-2934-4eef-bf86-a22be2dae761 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:46.264599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:46.265212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.265488 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.265757 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.268853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:46.269487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:46.273452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:46.273452 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:46.275773 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:46.277367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:46.286778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1370/2723] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:46.334164 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:46.335729 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da49569-dd63-404d-b464-ce2da0cb75ba service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:46.345016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1354/2724] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:47.404296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:47.414427 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066108e-3d84-471e-94bf-76f9a9660f97 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:47.418895 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:47.419551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:47.419827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:47.420095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] PATH_INFO: `/v3/users/29325cd28bd7429993c65f6a78704b52` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:47.421235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29325cd28bd7429993c65f6a78704b52)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:47.423160 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:47.638883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29325cd28bd7429993c65f6a78704b52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:47.639729 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29325cd28bd7429993c65f6a78704b52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:47.640403 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29325cd28bd7429993c65f6a78704b52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:47.654793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29325cd28bd7429993c65f6a78704b52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:47.760719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29325cd28bd7429993c65f6a78704b52'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:47.785268 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1371/2725] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:47 2022] DELETE /identity/v3/users/29325cd28bd7429993c65f6a78704b52 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:47.786953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:47.795670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:47.795670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:47.808917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:47.810139 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:47.871181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:47.911483 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1355/2726] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:47.925054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:47.926601 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:47.999882 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654884-a1d5-4568-8443-e70b71fdfa35 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:48.003585 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:48.004199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:48.004474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:48.004742 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:48.018194 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:48.026299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:48.030929 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1372/2727] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:48.773200 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:48.775846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:48.794520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:48.794520 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:48.804665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29436-95bc-48a7-874e-8026eb452e12 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:48.815879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4ec90-c680-4263-a745-4551706bfa89 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:48.819856 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:48.820522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:48.821281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:48.822373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] PATH_INFO: `/v3/projects/b1ca25169aa14bd3a1da5f972207f3eb` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:48.826071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ca25169aa14bd3a1da5f972207f3eb)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:48.827853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:48.830564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:48.830936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:48.831408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:48.831833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] PATH_INFO: `/v3/users/c21cb8ec1c474e23a1b1838f76d4fd17` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:48.836000 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21cb8ec1c474e23a1b1838f76d4fd17)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:48.842059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:49.075409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:49.094472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21cb8ec1c474e23a1b1838f76d4fd17'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.095337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21cb8ec1c474e23a1b1838f76d4fd17'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.095808 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ca25169aa14bd3a1da5f972207f3eb', 'request_id': 'req-c2264867-3f0b-4e7d-b061-0099f70dc047'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.096634 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21cb8ec1c474e23a1b1838f76d4fd17'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.105220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ca25169aa14bd3a1da5f972207f3eb', 'request_id': 'req-c2264867-3f0b-4e7d-b061-0099f70dc047'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.113402 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ca25169aa14bd3a1da5f972207f3eb', 'request_id': 'req-c2264867-3f0b-4e7d-b061-0099f70dc047'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.124260 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21cb8ec1c474e23a1b1838f76d4fd17'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.244678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] The token cache is being invalidate because project b1ca25169aa14bd3a1da5f972207f3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:49.254580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.254580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.254580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1356/2728] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:48 2022] DELETE /identity/v3/projects/b1ca25169aa14bd3a1da5f972207f3eb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:49.254580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:49.254580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:49.300994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21cb8ec1c474e23a1b1838f76d4fd17'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.344372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1373/2729] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:48 2022] DELETE /identity/v3/users/c21cb8ec1c474e23a1b1838f76d4fd17 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:49.352088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264867-3f0b-4e7d-b061-0099f70dc047 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:49.469379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:49.470221 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:49.470680 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:49.471085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] PATH_INFO: `/v3/users/f75c2493dd734cc485fec29ac551fac7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:49.472917 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75c2493dd734cc485fec29ac551fac7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:49.475020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:49.534128 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:49.746801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75c2493dd734cc485fec29ac551fac7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.747480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75c2493dd734cc485fec29ac551fac7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.756000 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75c2493dd734cc485fec29ac551fac7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.800070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75c2493dd734cc485fec29ac551fac7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.811573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:49.813951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:49.861281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21878-ca4f-4bf1-8f67-fd59388fac4c admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:49.871741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:49.872652 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:49.873121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:49.873399 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] PATH_INFO: `/v3/projects/554d7e3dd15e4a98a8e29174a384bd34` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:49.874608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554d7e3dd15e4a98a8e29174a384bd34)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:49.876810 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:49.890160 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75c2493dd734cc485fec29ac551fac7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:49.911241 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1357/2730] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:49 2022] DELETE /identity/v3/users/f75c2493dd734cc485fec29ac551fac7 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:50.025356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554d7e3dd15e4a98a8e29174a384bd34', 'request_id': 'req-e0d9b0a6-e625-458f-a495-d0728293ed26'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.038686 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554d7e3dd15e4a98a8e29174a384bd34', 'request_id': 'req-e0d9b0a6-e625-458f-a495-d0728293ed26'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.142331 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554d7e3dd15e4a98a8e29174a384bd34', 'request_id': 'req-e0d9b0a6-e625-458f-a495-d0728293ed26'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.167131 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] The token cache is being invalidate because project 554d7e3dd15e4a98a8e29174a384bd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:50.169738 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.172081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.175212 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1374/2731] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:49 2022] DELETE /identity/v3/projects/554d7e3dd15e4a98a8e29174a384bd34 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:50.180428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:50.182684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:50.283283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf756a8-645b-4da9-8e30-df5bf1f66e0e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:50.385952 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:50.386846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:50.387190 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:50.387824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] PATH_INFO: `/v3/users/0ade5679ab9242b6b10da66841c88f31` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:50.388785 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ade5679ab9242b6b10da66841c88f31)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:50.390886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:50.476246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:50.476246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:50.506528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b0a6-e625-458f-a495-d0728293ed26 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:50.524117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:50.524785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:50.525064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:50.525544 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] PATH_INFO: `/v3/projects/c34048c8c9014dc0b42571b9c9919f54` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:50.535593 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34048c8c9014dc0b42571b9c9919f54)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:50.537755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:50.721807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ade5679ab9242b6b10da66841c88f31'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.722700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ade5679ab9242b6b10da66841c88f31'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.729196 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34048c8c9014dc0b42571b9c9919f54', 'request_id': 'req-ba354894-b5d6-4be3-906d-8bd3b8077150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.734239 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ade5679ab9242b6b10da66841c88f31'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.738132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34048c8c9014dc0b42571b9c9919f54', 'request_id': 'req-ba354894-b5d6-4be3-906d-8bd3b8077150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.748135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ade5679ab9242b6b10da66841c88f31'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.811356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34048c8c9014dc0b42571b9c9919f54', 'request_id': 'req-ba354894-b5d6-4be3-906d-8bd3b8077150'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.826071 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] The token cache is being invalidate because project c34048c8c9014dc0b42571b9c9919f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:50.827031 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.827846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ba354894-b5d6-4be3-906d-8bd3b8077150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.829704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1375/2732] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:50 2022] DELETE /identity/v3/projects/c34048c8c9014dc0b42571b9c9919f54 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:50.834339 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:50.834618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:50.835150 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:50.858172 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:50.859613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:50.869541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c3734945-8915-4d8b-91aa-8e88874d8e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ade5679ab9242b6b10da66841c88f31'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:50.877938 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1358/2733] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:17:50 2022] DELETE /identity/v3/users/0ade5679ab9242b6b10da66841c88f31 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:50.879102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:50.951961 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1376/2734] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:50.961450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:50.962163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:50.962163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:50.983307 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:50.984784 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:51.003748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:51.064324 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1359/2735] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:51.068322 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.079259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdaf7c-c233-4a7d-925f-4e392166ff29 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.087610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.087610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.087610 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.088152 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.089337 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:51.089647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.091304 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.105279 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1377/2736] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:51.118209 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.129828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd5d4-a7ef-4963-855c-9ba72716d0d8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.137582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.143711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.143711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.143711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.143711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.143711 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.286543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1360/2737] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:51.291054 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.303406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a35-93c4-40b9-8fd3-b39ed784abc1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.387609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.390026 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.390686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:51.391254 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.391796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.392076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.392752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.394763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.407043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f20e8-4646-4176-8b5c-6b24833e7404 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.411900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.412542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.412815 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.413132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] PATH_INFO: `/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.414467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cfca87ac5c4a3d89a5dea4a3a66aa6)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.416407 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.504651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1378/2738] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:51.507628 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.517744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bac79-eecb-4e59-8100-90a8df5f40cc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.522946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.523687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.524193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.524817 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.525766 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.527722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.538986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1379/2739] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:51.543349 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.544226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cfca87ac5c4a3d89a5dea4a3a66aa6', 'request_id': 'req-769cf9c2-ec59-4107-9625-df20466b2ec7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:51.551814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cfca87ac5c4a3d89a5dea4a3a66aa6', 'request_id': 'req-769cf9c2-ec59-4107-9625-df20466b2ec7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:51.554905 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f59c0-bb3a-4650-8c09-ae758a165108 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.560106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cfca87ac5c4a3d89a5dea4a3a66aa6', 'request_id': 'req-769cf9c2-ec59-4107-9625-df20466b2ec7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:51.619527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.619698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.620055 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.620243 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.620951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.622550 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.637353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1380/2740] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:51.642945 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.650769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a144987-6842-480b-ab12-5d0223623524 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.655927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.656844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.657206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.657492 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] PATH_INFO: `/v3/projects/1ae8fd15d1de4a8e81ecc97db9b90281/users/277b963f2fd34dfc836ac88b2deb15e1/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.676356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] The token cache is being invalidate because project 92cfca87ac5c4a3d89a5dea4a3a66aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:17:51.676663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:51.677681 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-769cf9c2-ec59-4107-9625-df20466b2ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:17:51.680686 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1361/2741] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:17:51 2022] DELETE /identity/v3/projects/92cfca87ac5c4a3d89a5dea4a3a66aa6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:51.682663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae8fd15d1de4a8e81ecc97db9b90281, user_id=277b963f2fd34dfc836ac88b2deb15e1, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.686135 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104739-7da6-4fe3-a1eb-3926ad79955f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.687582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104739-7da6-4fe3-a1eb-3926ad79955f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.688060 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104739-7da6-4fe3-a1eb-3926ad79955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.706110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f1078-7e56-4c8f-9f13-632ef6712b75 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.717180 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-73104739-7da6-4fe3-a1eb-3926ad79955f None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:51.719071 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-73104739-7da6-4fe3-a1eb-3926ad79955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:51.732098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1362/2742] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:51.740329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.740712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.741085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.777801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:51.778791 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:51.792317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1363/2743] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:51.793805 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.806443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1381/2744] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:51 2022] PUT /identity/v3/projects/1ae8fd15d1de4a8e81ecc97db9b90281/users/277b963f2fd34dfc836ac88b2deb15e1/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:51.808755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14640-1f61-4e23-aff2-c0235bc4a6fc None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.820863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.833744 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.834402 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.890441 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.891460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.891929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.892359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.893459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:17:51.894108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.895850 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.897149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] MFA Rules not processed for user `277b963f2fd34dfc836ac88b2deb15e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:51.898862 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:51.917156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1364/2745] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:17:51.918234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:51.929248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658584e2-20f5-4e7f-b7f7-98f8ab294fb7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:51.935248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:51.941430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:51.941430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:51.941430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:51.941430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:51.941430 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:51.995826 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1382/2746] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:52.000527 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.004761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:52.018253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100cd4-a7e8-4afa-9a09-e5e96dc90538 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.024358 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.027551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.027551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.027551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.027551 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.028709 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.092031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1365/2747] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:52.094745 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.174248 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1383/2748] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:51 2022] POST /identity/v3/projects => generated 363 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:52.188812 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.222738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b996c-c550-4d53-a009-53e60435234e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.284221 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149243-7084-460d-bcd3-1482827398a1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.297224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.298181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.298460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.298818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.299472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.301443 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.306557 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.307179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.307459 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.307741 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.308409 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.310582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.433761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1384/2749] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:52 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:52.437902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1366/2750] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:52 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:52.438093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.439529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.452027 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b02e-a86e-4533-91a6-bddb2d986786 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.452283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496c3bd-2e9d-4cae-a480-5a0c2a3cce1a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.457414 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.457682 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.458371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.458620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.458792 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.459019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.459489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.459761 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.460480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.461558 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.461676 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.463469 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.480153 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1385/2751] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:52.480599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1367/2752] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:52.484999 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.485263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.497895 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce95093-0275-43f4-81de-c127c0598a9a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.498305 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f513b09-ecd7-4455-9c75-f3535c98b4ef admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.503415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.504086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.504233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.504352 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.504607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.504721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.504986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.505266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] PATH_INFO: `/v3/projects/cf618785d60b41879259e4cde79dc5b3/users/3d4b1f88438148ccb77959477f8e89a4/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.505382 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.507129 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.527076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1368/2753] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:52.531985 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.536461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf618785d60b41879259e4cde79dc5b3, user_id=3d4b1f88438148ccb77959477f8e89a4, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.539820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.554508 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1cda-bab9-4fca-a684-6841642ebfe5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.559976 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.561283 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.562270 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.562770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] PATH_INFO: `/v3/projects/8e37d83341b34cc69be89a9ffad994ad/users/7c23cb723be04a12848ba79c0ae9c4b8/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.587371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37d83341b34cc69be89a9ffad994ad, user_id=7c23cb723be04a12848ba79c0ae9c4b8, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.590027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e7cc7-4a3b-4d53-891b-b13f16236f71 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.632632 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1386/2754] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:52 2022] PUT /identity/v3/projects/cf618785d60b41879259e4cde79dc5b3/users/3d4b1f88438148ccb77959477f8e89a4/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:52.636630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.735244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1369/2755] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:52 2022] PUT /identity/v3/projects/8e37d83341b34cc69be89a9ffad994ad/users/7c23cb723be04a12848ba79c0ae9c4b8/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:52.735845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c829-dec2-4b16-b800-65ff8ef03a52 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.747375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.747770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.748505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.789304 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] MFA Rules not processed for user `7c23cb723be04a12848ba79c0ae9c4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:52.790630 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:52.850206 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.850834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.850834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.851292 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.852229 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.854093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.867193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1387/2756] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:52.876740 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.892465 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e86b0f-b81f-4601-be40-4e658e8234a5 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.899034 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1370/2757] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:52.903586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.904286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.904572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.904853 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] PATH_INFO: `/v3/projects/cf618785d60b41879259e4cde79dc5b3/users/3d4b1f88438148ccb77959477f8e89a4/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.905025 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:52.906982 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf618785d60b41879259e4cde79dc5b3, user_id=3d4b1f88438148ccb77959477f8e89a4, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.915149 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa838d-d53b-466b-a34e-3c9a563682b4 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.917450 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25923c05-3dbe-47e1-bc48-2fca9b21462f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:52.922880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:52.923807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.924258 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.924586 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.925141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:52.927088 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:52.942969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1388/2758] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:52 2022] PUT /identity/v3/projects/cf618785d60b41879259e4cde79dc5b3/users/3d4b1f88438148ccb77959477f8e89a4/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:52.958384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:52.959146 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:52.959667 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:52.997533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] MFA Rules not processed for user `3d4b1f88438148ccb77959477f8e89a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:52.999137 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:53.060009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1371/2759] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:52 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:53.064058 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.071743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:53.093124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1389/2760] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:17:53.107379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.108834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:53.128640 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:53.151220 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfa43-42f9-4fc6-b410-cb804a85e631 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.158415 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.159082 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.159454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.159622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.160354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.164004 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fe308-ae2f-4420-873b-63660dc107cd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.191320 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72deca-6ccc-447f-b1d4-242e94f6b77d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.252943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1372/2761] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:53.253623 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.254346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.254691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.255063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.255479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cd51-d199-4467-858d-a45410453995 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.255982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cd51-d199-4467-858d-a45410453995 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.256516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142cd51-d199-4467-858d-a45410453995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.292513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3142cd51-d199-4467-858d-a45410453995 None None] MFA Rules not processed for user `1c8cf21524db41daa185f432aa442ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:53.293841 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3142cd51-d199-4467-858d-a45410453995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:53.326820 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.328299 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.341865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1390/2762] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:17:53.342838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.354057 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763146c-53ac-4bfc-aa3a-b8925b834fe8 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.359238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.359894 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.360175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.360452 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.361147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.363378 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.379514 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1391/2763] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:53.380679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.394608 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce63577-17cf-4f20-afd2-834fc1ef5519 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.401689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.402541 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.402986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.403361 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.404310 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.406258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.408575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1373/2764] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:53.411466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cd51-d199-4467-858d-a45410453995 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.413475 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3142cd51-d199-4467-858d-a45410453995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:53.432059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1392/2765] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:53.438455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.441237 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142cd51-d199-4467-858d-a45410453995 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.448362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.448900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.449234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.449668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.450594 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.452816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7c44c-9d68-4273-9d4f-276a6feb9a2b admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.452947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.460752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.461594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.461975 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.462624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] PATH_INFO: `/v3/projects/85a9a5f2fa34489cbefba6e76fd02903/users/3bc64baf476942678286b91ef399cca9/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.495917 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a9a5f2fa34489cbefba6e76fd02903, user_id=3bc64baf476942678286b91ef399cca9, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.499024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.554215 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1374/2766] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:53.557991 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.583509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1393/2767] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:53 2022] PUT /identity/v3/projects/85a9a5f2fa34489cbefba6e76fd02903/users/3bc64baf476942678286b91ef399cca9/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:53.599495 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.719978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47222b94-a05c-4cfb-a0d9-b5ec6e4aff96 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.736353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d917-70aa-4249-a784-9d009691352e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.740442 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.741142 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.742032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.742375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.749188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:53.786355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.787211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.787659 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.788232 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.789207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.796461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.814639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.814639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de580a3-1327-4453-9593-72d368cc0adb service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.822389 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1394/2768] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:53.825702 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.825830 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.826385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.871147 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] MFA Rules not processed for user `3bc64baf476942678286b91ef399cca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:53.877228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:53.906568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1375/2769] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/users => generated 298 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:17:53.909048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.920609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22aca-49d2-45a6-8a55-78d3da6a1af8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.925983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.926558 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.927019 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.927953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.929967 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:53.931550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:53.954832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1376/2770] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:53.956031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:53.972622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a016-a26a-4c0f-af01-3082e8a6e0a6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:53.989457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:53.990184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:53.990449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:53.990782 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] PATH_INFO: `/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263/users/327104a2c01947e0b115bd3f58e10003/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:53.992802 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1395/2771] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:53.995880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.013263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143122a6-595a-444e-b7e9-0f3336ac1da0 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.020850 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.021796 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.022126 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.023511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=706e2ee2c72442cb86d21a3f3b1fe263, user_id=327104a2c01947e0b115bd3f58e10003, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.024224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.025002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.026342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.027408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.187974 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1377/2772] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:53 2022] PUT /identity/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263/users/327104a2c01947e0b115bd3f58e10003/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:54.192689 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.195428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1396/2773] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:17:53 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:54.199369 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.267866 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86b67-971f-4704-96c9-46e6bc39fdfa admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.270641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59103705-c194-413c-a935-4afa221bbfb0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.275807 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.276444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.276730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.277010 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.277710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.278501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.279362 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.279525 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.279949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.280379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.281227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.283591 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.290567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1378/2774] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:54.296225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:54.297428 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.310828 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06653890-5c7c-480f-aadf-780d83603717 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.318338 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.319125 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.320067 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.320471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] PATH_INFO: `/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263/users/327104a2c01947e0b115bd3f58e10003/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.323541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=706e2ee2c72442cb86d21a3f3b1fe263, user_id=327104a2c01947e0b115bd3f58e10003, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.326579 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.346657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1379/2775] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:54 2022] PUT /identity/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263/users/327104a2c01947e0b115bd3f58e10003/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:54.422666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1397/2776] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:17:54 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:17:54.424622 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.560602 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f76d19-6a93-4d66-94d3-2018e097e09b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.587588 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.588305 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.588585 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.588865 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.592007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.596973 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.617420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1380/2777] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:17:54.621276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.630611 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:54.638187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdf12e-a6da-4bc8-91ed-fe189be7f678 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.653646 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.654640 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.655357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.655827 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] PATH_INFO: `/v3/projects/11e30ced73c2479f9a8484e52bdf1031/users/0b9483d55ea04283ae6387410a30546d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.675555 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e30ced73c2479f9a8484e52bdf1031, user_id=0b9483d55ea04283ae6387410a30546d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.679363 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.816854 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1398/2778] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:54 2022] PUT /identity/v3/projects/11e30ced73c2479f9a8484e52bdf1031/users/0b9483d55ea04283ae6387410a30546d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:17:54.820383 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.833810 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492567-feee-46d3-901b-41cb86eece20 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:54.956527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:54.957683 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:54.957971 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:54.958253 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:54.959006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:54.962329 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f3f0e-4ee5-4795-990f-2d276cfbaa07 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:54.975468 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1381/2779] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:17:54.980472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:54.997197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b93f6-1cc7-40e8-a017-d8feccc6ff48 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:55.010924 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:55.012302 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:55.012636 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:55.013012 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] PATH_INFO: `/v3/projects/11e30ced73c2479f9a8484e52bdf1031/users/0b9483d55ea04283ae6387410a30546d/roles/43d4d104da3d43f8b37c7b40de6d6c84` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:55.015530 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e30ced73c2479f9a8484e52bdf1031, user_id=0b9483d55ea04283ae6387410a30546d, role_id=43d4d104da3d43f8b37c7b40de6d6c84)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:55.018296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:55.030474 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1399/2780] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:17:54 2022] PUT /identity/v3/projects/11e30ced73c2479f9a8484e52bdf1031/users/0b9483d55ea04283ae6387410a30546d/roles/43d4d104da3d43f8b37c7b40de6d6c84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:17:55.041631 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:55.041943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:55.054424 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:55.075954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] MFA Rules not processed for user `0b9483d55ea04283ae6387410a30546d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:17:55.077615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:55.197389 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1382/2781] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:17:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:17:55.206834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:55.208444 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:17:55.233108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:55.315400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b10b5-e67a-4116-838f-708d0d338ca3 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:55.319985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:55.320669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:55.320952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:55.321225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:55.402128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:55.403815 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:55.418114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1400/2782] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:56.078595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:57.200399 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:57.715020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:57.715995 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:57.726041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe9369-498c-4e4a-a0e1-7be7385e2437 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:57.729732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:57.730359 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:57.730687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:57.730908 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:57.812257 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:57.814419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad074-278a-4c90-85e4-49ac8a5c7780 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:57.825316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1383/2783] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:17:58.570486 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:17:59.691832 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:17:59.708440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d7b99-c4b1-44fa-9ad7-f62139e21459 service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:17:59.714865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:17:59.715881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:17:59.716371 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:17:59.716852 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:17:59.728837 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:17:59.730680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:17:59.742892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1401/2784] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:01.112081 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959aea8-8561-4211-a6d4-c360a8848d34 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:01.112516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959aea8-8561-4211-a6d4-c360a8848d34 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:01.113095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959aea8-8561-4211-a6d4-c360a8848d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:01.148601 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1959aea8-8561-4211-a6d4-c360a8848d34 None None] MFA Rules not processed for user `327104a2c01947e0b115bd3f58e10003`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:01.150185 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1959aea8-8561-4211-a6d4-c360a8848d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:01.262678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1384/2785] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:01.278631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:01.278631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:01.344170 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4edba-91f9-4827-a438-ff557a63cc3f service cinder] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:01.349245 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:01.349855 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:01.350127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:01.350691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:01.386825 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:01.447682 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:01.449424 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:01.459110 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1402/2786] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:01.766511 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:01.766829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:01.767108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:01.822195 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:01.823477 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:01.854234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:01.890018 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1385/2787] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:02.069043 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:02.071193 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:02.141418 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7569ad-ec78-4a0d-bf5d-63b9a795e748 service glance] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:02.146865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:02.148038 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:02.148913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:02.149189 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:02.157595 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:02.159207 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:02.167969 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1403/2788] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:03.437047 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:03.438687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:03.570516 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ae75-62f3-41d0-99ab-acdaa00089a6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:03.577191 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:03.578069 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:03.578345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:03.578905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:03.582235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:03.693569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:03.696360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:03.723437 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1386/2789] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:04.845784 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:04.978635 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:05.028879 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c04d-89ec-4d30-9ee1-a04e4132bad3 service swift] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:05.044228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:05.045281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:05.045755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:05.046348 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] PATH_INFO: `/v3/users/277b963f2fd34dfc836ac88b2deb15e1` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:05.049197 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277b963f2fd34dfc836ac88b2deb15e1)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:05.054407 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:05.142846 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de11b6-a91b-45ec-b599-c897db745d21 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:05.149275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:05.150765 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:05.151246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:05.151730 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] PATH_INFO: `/v3/users/7c23cb723be04a12848ba79c0ae9c4b8` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:05.153144 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c23cb723be04a12848ba79c0ae9c4b8)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:05.159132 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:05.193319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:05.377002 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277b963f2fd34dfc836ac88b2deb15e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.378048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277b963f2fd34dfc836ac88b2deb15e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.378932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277b963f2fd34dfc836ac88b2deb15e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.413883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:05.421717 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c23cb723be04a12848ba79c0ae9c4b8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.422440 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c23cb723be04a12848ba79c0ae9c4b8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.423990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277b963f2fd34dfc836ac88b2deb15e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.439555 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c23cb723be04a12848ba79c0ae9c4b8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.463230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c23cb723be04a12848ba79c0ae9c4b8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.752258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-333f382a-cffb-4d63-afc6-9215605727e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277b963f2fd34dfc836ac88b2deb15e1'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.778823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1404/2790] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:04 2022] DELETE /identity/v3/users/277b963f2fd34dfc836ac88b2deb15e1 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:05.780502 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:05.780845 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:05.781132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:05.805893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:05.807258 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:05.837862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cb0d73b-d395-47b0-87bc-d0d490aac469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c23cb723be04a12848ba79c0ae9c4b8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:05.844983 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1387/2791] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:04 2022] DELETE /identity/v3/users/7c23cb723be04a12848ba79c0ae9c4b8 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:05.849700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:05.850313 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:05.851012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:05.883478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:05.885048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:05.934952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1405/2792] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:05.945187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:05.946901 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:05.981278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1388/2793] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:05.992231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:05.996027 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:06.044188 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f385a3-b9db-496a-bf5f-4e42bd29ab0e None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:06.079515 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb55c7-c51b-45a1-bdc4-212bcfabd365 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:06.084080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:06.085017 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:06.085604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:06.088273 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:06.101670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:06.103421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:06.115760 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:06.117108 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1389/2794] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:06.117396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:06.117885 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:06.118259 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:06.129906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:06.131621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:06.144145 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1406/2795] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:18:06.691628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:06.693505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:06.833898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:06.868573 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:06.870816 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:06.895653 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b1af4-af81-4ff9-98f7-7842a9ae2e04 service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:06.905630 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:06.906297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:06.906578 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:06.906906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] PATH_INFO: `/v3/projects/8e37d83341b34cc69be89a9ffad994ad` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:06.911539 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e37d83341b34cc69be89a9ffad994ad)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:06.916220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:06.923762 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058a090-69ac-4d52-ba8d-895adbc5ce12 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:06.935036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:06.935969 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:06.936401 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:06.936827 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:06.940590 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:06.959685 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:06.963154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:07.004599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1390/2796] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:07.005777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:07.007225 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:07.037043 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c67f-abc0-472e-b765-92a94c72eaec service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:07.051563 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:07.064567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:07.064567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:07.064567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] PATH_INFO: `/v3/projects/1ae8fd15d1de4a8e81ecc97db9b90281` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:07.064567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae8fd15d1de4a8e81ecc97db9b90281)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:07.065667 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:07.088958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:07.136480 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e37d83341b34cc69be89a9ffad994ad', 'request_id': 'req-074ce5b2-0a0a-40d1-9c9a-548e7644a980'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.152498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e37d83341b34cc69be89a9ffad994ad', 'request_id': 'req-074ce5b2-0a0a-40d1-9c9a-548e7644a980'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.258390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae8fd15d1de4a8e81ecc97db9b90281', 'request_id': 'req-e72640f3-591e-43a5-8242-1e6bc78569ff'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.258923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e37d83341b34cc69be89a9ffad994ad', 'request_id': 'req-074ce5b2-0a0a-40d1-9c9a-548e7644a980'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.279764 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] The token cache is being invalidate because project 8e37d83341b34cc69be89a9ffad994ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:07.280342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.281169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.283365 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1407/2797] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:06 2022] DELETE /identity/v3/projects/8e37d83341b34cc69be89a9ffad994ad => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:07.286943 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae8fd15d1de4a8e81ecc97db9b90281', 'request_id': 'req-e72640f3-591e-43a5-8242-1e6bc78569ff'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.291680 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:07.293384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:07.309482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae8fd15d1de4a8e81ecc97db9b90281', 'request_id': 'req-e72640f3-591e-43a5-8242-1e6bc78569ff'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.425194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] The token cache is being invalidate because project 1ae8fd15d1de4a8e81ecc97db9b90281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:07.425571 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.426436 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.431639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1391/2798] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:07 2022] DELETE /identity/v3/projects/1ae8fd15d1de4a8e81ecc97db9b90281 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:07.433230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:07.435183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:07.448922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ce5b2-0a0a-40d1-9c9a-548e7644a980 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:07.603187 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72640f3-591e-43a5-8242-1e6bc78569ff admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:07.604347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:07.605024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:07.605400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:07.605694 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] PATH_INFO: `/v3/users/3bc64baf476942678286b91ef399cca9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:07.607499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc64baf476942678286b91ef399cca9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:07.609472 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:07.618942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:07.620487 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:07.620930 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:07.621871 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] PATH_INFO: `/v3/users/3d4b1f88438148ccb77959477f8e89a4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:07.623476 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4b1f88438148ccb77959477f8e89a4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:07.626016 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:07.858271 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc64baf476942678286b91ef399cca9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.859025 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc64baf476942678286b91ef399cca9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.859809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc64baf476942678286b91ef399cca9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.878590 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc64baf476942678286b91ef399cca9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.879860 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:07.914603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4b1f88438148ccb77959477f8e89a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.916584 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4b1f88438148ccb77959477f8e89a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.924767 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:07.927863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4b1f88438148ccb77959477f8e89a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.942219 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4b1f88438148ccb77959477f8e89a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.958263 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc64baf476942678286b91ef399cca9'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:07.987783 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1408/2799] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:07 2022] DELETE /identity/v3/users/3bc64baf476942678286b91ef399cca9 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:08.049479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4b1f88438148ccb77959477f8e89a4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:08.057231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1392/2800] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:07 2022] DELETE /identity/v3/users/3d4b1f88438148ccb77959477f8e89a4 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:08.666205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:08.667720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:08.670207 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:08.672614 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:08.763379 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb9ff8-4b21-442b-8eec-5fc55833929a admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:08.792675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b556c-5c41-4269-a0ba-88daf35560c7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:08.799666 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:08.800462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:08.800847 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:08.801223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] PATH_INFO: `/v3/projects/cf618785d60b41879259e4cde79dc5b3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:08.805050 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf618785d60b41879259e4cde79dc5b3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:08.810460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:08.847463 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:08.849001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:08.849438 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:08.849888 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] PATH_INFO: `/v3/projects/85a9a5f2fa34489cbefba6e76fd02903` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:08.851589 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a9a5f2fa34489cbefba6e76fd02903)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:08.853722 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:08.946342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf618785d60b41879259e4cde79dc5b3', 'request_id': 'req-efbbc358-dd86-432a-b33e-902d7ae021f8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:08.953720 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf618785d60b41879259e4cde79dc5b3', 'request_id': 'req-efbbc358-dd86-432a-b33e-902d7ae021f8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:08.966417 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf618785d60b41879259e4cde79dc5b3', 'request_id': 'req-efbbc358-dd86-432a-b33e-902d7ae021f8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:08.973913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a9a5f2fa34489cbefba6e76fd02903', 'request_id': 'req-74300004-5967-425e-ae6e-1f155cc4526e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:08.980093 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a9a5f2fa34489cbefba6e76fd02903', 'request_id': 'req-74300004-5967-425e-ae6e-1f155cc4526e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.078742 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] The token cache is being invalidate because project cf618785d60b41879259e4cde79dc5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:09.079327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.079738 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-efbbc358-dd86-432a-b33e-902d7ae021f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.081639 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1393/2801] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:08 2022] DELETE /identity/v3/projects/cf618785d60b41879259e4cde79dc5b3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:09.086493 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba84ea-6455-4569-bd0e-c2f275c97cc3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.092238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba84ea-6455-4569-bd0e-c2f275c97cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.092238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba84ea-6455-4569-bd0e-c2f275c97cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.114874 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b3ba84ea-6455-4569-bd0e-c2f275c97cc3 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:09.118498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a9a5f2fa34489cbefba6e76fd02903', 'request_id': 'req-74300004-5967-425e-ae6e-1f155cc4526e'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.118649 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b3ba84ea-6455-4569-bd0e-c2f275c97cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:09.133621 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] The token cache is being invalidate because project 85a9a5f2fa34489cbefba6e76fd02903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:09.134008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.135294 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.136956 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1409/2802] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:08 2022] DELETE /identity/v3/projects/85a9a5f2fa34489cbefba6e76fd02903 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:09.140691 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.142063 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:09.179522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:09.234133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1394/2803] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:09.242829 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.243116 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.243393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.253309 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:09.258468 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74300004-5967-425e-ae6e-1f155cc4526e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.268763 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.269553 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.269923 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.270423 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] PATH_INFO: `/v3/users/0b9483d55ea04283ae6387410a30546d` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.271948 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:09.272851 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9483d55ea04283ae6387410a30546d)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.273777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:09.278683 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.286770 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1395/2804] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:09.291867 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.311748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c130d-251a-43e5-a77f-92c724c8ad75 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.318629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.319390 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.319752 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.320031 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.320724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:09.321024 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.322663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.347110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1396/2805] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:09.351793 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.365365 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b30a24-3c74-4d2e-a54a-d8cc5e1e9c09 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.370786 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.371294 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.371536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.371814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.372492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.374471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.514900 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1397/2806] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:09 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:09.519416 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.550509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9483d55ea04283ae6387410a30546d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.551227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9483d55ea04283ae6387410a30546d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.551833 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9483d55ea04283ae6387410a30546d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.568893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9483d55ea04283ae6387410a30546d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.614665 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d8764-2f2b-4ad9-b2d9-74ad29707fbf admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.622252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.623231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.623684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.623957 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.624621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.626545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.640548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9483d55ea04283ae6387410a30546d'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:09.657572 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1410/2807] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:09 2022] DELETE /identity/v3/users/0b9483d55ea04283ae6387410a30546d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:09.753615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1398/2808] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:09 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:09.758872 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.761355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:09.856642 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa076-a88a-478c-b5b8-04d4ce5c94e9 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.864373 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.865256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.868788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.868788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.868788 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.869171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.880409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1411/2809] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:09.885482 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.898875 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a93cd-c990-4bde-8364-d6eafd31b2f4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.909037 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.911830 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.912308 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.919152 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.919902 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.921582 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b419fba-2b90-4bad-8fb2-afe33e790dec admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:09.933668 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1399/2810] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:18:09.937748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:09.949692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c62e84-a681-4c64-bff0-eee553d59d66 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:09.955658 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:09.956346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:09.956631 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:09.956932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] PATH_INFO: `/v3/projects/1597eae8c02a47d994c6f49613277884/users/b1698e60bc8b4632b293e76e844d9fe8/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:09.974426 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597eae8c02a47d994c6f49613277884, user_id=b1698e60bc8b4632b293e76e844d9fe8, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:09.977687 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:10.713162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1412/2811] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:09 2022] PUT /identity/v3/projects/1597eae8c02a47d994c6f49613277884/users/b1698e60bc8b4632b293e76e844d9fe8/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:10.724113 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:10.724603 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:10.724712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:10.753033 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] MFA Rules not processed for user `b1698e60bc8b4632b293e76e844d9fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:10.754472 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:10.764132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:10.773863 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:10.812301 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:10.855628 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1400/2812] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:10.864853 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:10.867188 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:10.897314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1cd5-acab-4646-a036-6b4cd206ad54 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:10.903565 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:10.909633 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:10.910681 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:10.911191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:10.911467 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] PATH_INFO: `/v3/projects/11e30ced73c2479f9a8484e52bdf1031` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:10.912656 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e30ced73c2479f9a8484e52bdf1031)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:10.914892 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:10.942694 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1a535-798e-4e42-bda9-cbd1d7fef748 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:10.948814 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:10.955214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:10.955214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:10.955214 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:10.963285 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:10.965030 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:10.977127 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1401/2813] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:18:10.998852 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.010777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febe32-0ce1-4b79-86e0-954fac20724b service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.017249 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.018133 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.018419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.018698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] PATH_INFO: `/v3/users/b1698e60bc8b4632b293e76e844d9fe8` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.019928 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1698e60bc8b4632b293e76e844d9fe8)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.022159 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.060122 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e30ced73c2479f9a8484e52bdf1031', 'request_id': 'req-676d0887-0226-4551-aeb5-01d9c199a886'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.067487 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e30ced73c2479f9a8484e52bdf1031', 'request_id': 'req-676d0887-0226-4551-aeb5-01d9c199a886'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.157417 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e30ced73c2479f9a8484e52bdf1031', 'request_id': 'req-676d0887-0226-4551-aeb5-01d9c199a886'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.175719 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] The token cache is being invalidate because project 11e30ced73c2479f9a8484e52bdf1031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:11.176227 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.177021 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-676d0887-0226-4551-aeb5-01d9c199a886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.182877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1413/2814] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:10 2022] DELETE /identity/v3/projects/11e30ced73c2479f9a8484e52bdf1031 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:11.184346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0685-a39c-49a8-a6f6-7e5d38466f9c None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.184775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0685-a39c-49a8-a6f6-7e5d38466f9c None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.185129 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0685-a39c-49a8-a6f6-7e5d38466f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.208099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-2f9c0685-a39c-49a8-a6f6-7e5d38466f9c None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:11.209561 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-2f9c0685-a39c-49a8-a6f6-7e5d38466f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:11.232550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1698e60bc8b4632b293e76e844d9fe8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.233379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1698e60bc8b4632b293e76e844d9fe8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.242978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1698e60bc8b4632b293e76e844d9fe8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.262141 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1698e60bc8b4632b293e76e844d9fe8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.289385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1414/2815] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:11.298580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.299034 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.299347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.325678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:11.329937 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:11.338441 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1415/2816] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:11.342867 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.349550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5af78c9-426d-4c56-9f2e-b41018018c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1698e60bc8b4632b293e76e844d9fe8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:11.353341 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae21ea4-2bb0-44bb-a4cb-303fa7f33926 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.358362 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.359219 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.359569 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.359909 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.360730 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:11.361117 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.362492 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1402/2817] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:10 2022] DELETE /identity/v3/users/b1698e60bc8b4632b293e76e844d9fe8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:11.362838 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.367181 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.370275 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.370797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.376910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1416/2818] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:18:11.384068 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.385990 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:11.393979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:11.395766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:11.401211 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71742ba-09d2-433d-9bf0-5c6424287d53 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.441741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:11.495111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.495685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.495986 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.496231 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.496952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.497609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1403/2819] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:18:11.499204 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.513252 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.515199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:11.578229 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:11.589470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1417/2820] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:11 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:18:11.589698 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.593150 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e09c7-c9e8-4cdb-a3bb-a8c5b53e3a20 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.656897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.657629 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.657978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.658530 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.700225 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de33d-cadd-42d2-bef3-f2becbad20f1 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.709684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.710743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.711039 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.711314 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.711977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.713913 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.735036 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.740648 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.748826 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1404/2821] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:11.825771 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1418/2822] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:11 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:11.831816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.842887 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0649c31-9bd4-4fc1-a4b2-8112d8cac9e7 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.847774 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.848831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.849316 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.852712 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.857469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.857469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.866823 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1405/2823] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:11.870843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.883415 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6fa61-f810-40eb-a4f8-6a9151b47dde admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.888818 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.892429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.892429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.892429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.892429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.892429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e46a-f613-4700-a221-cf46795351e1 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:11.908194 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:11.909050 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1419/2824] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:11.920990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28e8c7-b157-43b5-acf4-f146034aa174 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:11.926278 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:11.927109 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:11.927471 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:11.927892 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] PATH_INFO: `/v3/projects/7f9836b298c948f38acb7d7626230115/users/a5cec2754a9a4564bacadf2359552437/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:11.949091 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9836b298c948f38acb7d7626230115, user_id=a5cec2754a9a4564bacadf2359552437, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:11.952388 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:12.036048 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1406/2825] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:11 2022] PUT /identity/v3/projects/7f9836b298c948f38acb7d7626230115/users/a5cec2754a9a4564bacadf2359552437/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:12.047509 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.047904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.048242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.085048 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] MFA Rules not processed for user `a5cec2754a9a4564bacadf2359552437`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:12.085978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:12.177205 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1420/2826] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:12.188990 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:12.191148 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:12.231586 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:12.233213 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:12.262641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:12.295206 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b552f56-23af-42ec-b833-9bc3318f4b79 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:12.301259 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:12.301979 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.302223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.302497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.314193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:12.315803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30c4d2-35ca-4525-afec-671fff7cb7ea service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:12.332059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fcf9-0615-4ddb-a09d-d2b451e4afdc None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:12.341734 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:12.342545 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.342948 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.343323 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] PATH_INFO: `/v3/projects/1597eae8c02a47d994c6f49613277884` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.343525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1407/2827] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:12.344759 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1597eae8c02a47d994c6f49613277884)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:12.347051 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:12.493903 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1597eae8c02a47d994c6f49613277884', 'request_id': 'req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:12.500811 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1597eae8c02a47d994c6f49613277884', 'request_id': 'req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:12.623533 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1597eae8c02a47d994c6f49613277884', 'request_id': 'req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:12.637099 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] The token cache is being invalidate because project 1597eae8c02a47d994c6f49613277884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:12.643655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:12.643655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-9edf1973-aa8d-47b6-b7c6-8b78760c12ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:12.643655 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1421/2828] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:12 2022] DELETE /identity/v3/projects/1597eae8c02a47d994c6f49613277884 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:12.646862 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaceccf-08a4-459c-9641-198595339e55 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.647357 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaceccf-08a4-459c-9641-198595339e55 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.647803 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaceccf-08a4-459c-9641-198595339e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.685175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-abaceccf-08a4-459c-9641-198595339e55 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:12.686420 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-abaceccf-08a4-459c-9641-198595339e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:12.704963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:12.771777 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1408/2829] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:12.789907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.789907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.789907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.806641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:12.808082 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:12.822755 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1422/2830] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:12.884376 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaceccf-08a4-459c-9641-198595339e55 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:12.900323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaceccf-08a4-459c-9641-198595339e55 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:12.906561 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:12.910256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.910256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.910256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.910256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:12.910256 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:12.911604 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:12.928168 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1409/2831] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:12.933400 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:12.945202 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6934bc5-438f-4481-acab-d991fa2088aa None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:12.950065 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:12.950669 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:12.950979 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:12.951251 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:12.951904 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:12.953844 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.082448 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:13.082663 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1423/2832] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:12 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:13.095937 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658278-6c10-4e1c-8854-0354eee2d59c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:13.177371 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:13.178242 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.179230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.181981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.181981 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:13.182354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.269317 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1410/2833] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:13 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:13.278834 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:13.291290 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9e45-0abb-46f3-9bdc-b454bd3c8dbc admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:13.297028 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:13.297916 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.298208 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.298482 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.299253 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:13.300893 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.323464 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1424/2834] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:13.325339 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:13.347507 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dae8b2-5b58-4aaa-bf6b-4a87817d55ab admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:13.355671 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:13.357028 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.357267 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.357655 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.358447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:13.360226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a855aa-aefe-4954-8fe2-735445f64c31 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.374624 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1411/2835] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:18:13.377717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:13.391695 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26490-fbba-4ddb-a93d-896f6744bd42 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:13.401907 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:13.402676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.403354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.403639 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] PATH_INFO: `/v3/projects/dac7d8bf78a34948ab332f9855859c54/users/44e3b5dc43fd4a5ba15e6afa565c7575/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.426600 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac7d8bf78a34948ab332f9855859c54, user_id=44e3b5dc43fd4a5ba15e6afa565c7575, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:13.426958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.499743 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1425/2836] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:13 2022] PUT /identity/v3/projects/dac7d8bf78a34948ab332f9855859c54/users/44e3b5dc43fd4a5ba15e6afa565c7575/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:18:13.510740 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4a57-151e-4bd9-a869-4fddfa323185 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.511042 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4a57-151e-4bd9-a869-4fddfa323185 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.511323 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce4a57-151e-4bd9-a869-4fddfa323185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.544715 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-68ce4a57-151e-4bd9-a869-4fddfa323185 None None] MFA Rules not processed for user `44e3b5dc43fd4a5ba15e6afa565c7575`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:13.545961 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68ce4a57-151e-4bd9-a869-4fddfa323185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:13.620434 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1412/2837] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:13.631103 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:13.633168 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:13.687671 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:13.699801 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ea9-3cf1-42a5-a20f-cbfbf0ac78a0 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:13.704276 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6485a82c946346f9b0a53a87056116ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:13.705013 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:13.705326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:13.705607 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:13.714798 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:13.716342 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:13.726140 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1426/2838] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:15.212569 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071c3f-4d9b-4928-b637-568b329635d8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:15.213110 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071c3f-4d9b-4928-b637-568b329635d8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:15.213223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071c3f-4d9b-4928-b637-568b329635d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:15.232134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c0071c3f-4d9b-4928-b637-568b329635d8 None None] MFA Rules not processed for user `1c8cf21524db41daa185f432aa442ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:15.233321 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c0071c3f-4d9b-4928-b637-568b329635d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:15.241250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:15.288817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1413/2839] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:24.448790 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=7 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:25.323245 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=19 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:27.597266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:27.598878 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:27.656575 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd069e8-6784-42c5-be8e-2ed866c87ccb service glance] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:27.660352 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:27.661003 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:27.661282 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:27.661587 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:27.663390 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:27.675326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:27.677100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:27.686769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1427/2840] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:31.012678 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:31.018499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:31.018499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:31.033344 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:31.034556 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:31.103118 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1414/2841] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:31.116428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:31.117944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:31.194962 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54743634-5cd8-4738-a585-cfe114a7b74c service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:31.201877 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:31.202503 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:31.202873 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:31.203154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:31.214615 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:31.216409 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8180a64-749a-4127-b7c0-37f2e001be61 service swift] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:31.238906 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1428/2842] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:18:35.433706 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:35.503076 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3eeb9-4e78-4fb6-bf57-db647d8bdd0e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:35.507621 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:35.508250 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:35.508527 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:35.508801 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] PATH_INFO: `/v3/users/44e3b5dc43fd4a5ba15e6afa565c7575` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:35.514855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e3b5dc43fd4a5ba15e6afa565c7575)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:35.514855 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:35.737898 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e3b5dc43fd4a5ba15e6afa565c7575'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.738641 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e3b5dc43fd4a5ba15e6afa565c7575'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.746818 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e3b5dc43fd4a5ba15e6afa565c7575'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.767002 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e3b5dc43fd4a5ba15e6afa565c7575'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.826406 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e3b5dc43fd4a5ba15e6afa565c7575'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:35.834924 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1415/2843] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:35 2022] DELETE /identity/v3/users/44e3b5dc43fd4a5ba15e6afa565c7575 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:35.839958 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:35.840459 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:35.840692 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:35.861673 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:35.863047 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:35.929220 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1429/2844] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:35.939201 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:35.940611 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:35.962186 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:36.005722 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ee5ce-fc3f-479a-b0ec-9e0ea07efa42 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:36.010684 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:36.011497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.011610 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.011813 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.024080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:36.026295 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ddfe0-fefd-4636-a40c-0126ffbb0621 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:36.038479 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1416/2845] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:36.556157 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:36.558164 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.600309 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23e23-cfe5-4aa3-ac69-e8ddf04c4148 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:36.611372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:36.612045 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.612328 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.613531 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] PATH_INFO: `/v3/projects/dac7d8bf78a34948ab332f9855859c54` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.615069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac7d8bf78a34948ab332f9855859c54)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:36.619246 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:36.721408 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:36.737175 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac7d8bf78a34948ab332f9855859c54', 'request_id': 'req-ee044afc-769b-407c-8aa6-c4d6eee59744'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.742647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac7d8bf78a34948ab332f9855859c54', 'request_id': 'req-ee044afc-769b-407c-8aa6-c4d6eee59744'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.812498 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac7d8bf78a34948ab332f9855859c54', 'request_id': 'req-ee044afc-769b-407c-8aa6-c4d6eee59744'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.844396 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] The token cache is being invalidate because project dac7d8bf78a34948ab332f9855859c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:36.846001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.846001 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ee044afc-769b-407c-8aa6-c4d6eee59744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:36.850727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1430/2846] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:36 2022] DELETE /identity/v3/projects/dac7d8bf78a34948ab332f9855859c54 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:36.852520 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.853327 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.853965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.875332 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:36.880599 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:36.959111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1417/2847] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:36.961224 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:36.961717 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:36.962111 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:36.984405 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:36.985700 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:37.001693 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.007060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1431/2848] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:37.015014 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec55f29-e3ae-4c98-9d7b-1e64a63f98db None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.019911 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.020743 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.021454 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.021739 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.022449 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:18:37.027066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.030319 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.047845 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1418/2849] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:18:37.051949 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.067776 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd86b-3b01-46a7-bada-4daa539f27df None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.068203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.068823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.069102 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.069375 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] PATH_INFO: `/v3/projects` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.070162 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.072114 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.164781 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1432/2850] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:37.169318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.179662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936025c4-01b6-4227-933f-7db730656ed3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.247395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.248142 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.248489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.248837 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.249575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.251779 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.341140 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1419/2851] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:18:37.345347 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.356329 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150d9b3-a4ac-4ead-9287-d3ec862fb61e admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.361284 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.361900 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.362184 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.362461 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.363203 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.365073 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.380460 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1433/2852] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:37.381617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.393623 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6c7bc-2759-4bd4-a3f1-c70e5f7b59ad admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.399238 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.400111 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.400525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.400963 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.401748 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.403545 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eae91-5605-4a4f-afd0-46602d4c2822 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.415780 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1420/2853] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:18:37.420843 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.431351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a483b28-3c7b-4d33-b6ab-ecc834ce5917 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.437132 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.437797 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.438076 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.438356 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] PATH_INFO: `/v3/projects/1c665ef1f6d841c78e0d1bc95de2fac3/users/6bbdaa939b9341fdabe3e5c19e0a1d69/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.453523 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c665ef1f6d841c78e0d1bc95de2fac3, user_id=6bbdaa939b9341fdabe3e5c19e0a1d69, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.456235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.532992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1434/2854] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:18:37 2022] PUT /identity/v3/projects/1c665ef1f6d841c78e0d1bc95de2fac3/users/6bbdaa939b9341fdabe3e5c19e0a1d69/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:37.545517 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.545797 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.546068 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.579342 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] MFA Rules not processed for user `6bbdaa939b9341fdabe3e5c19e0a1d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:37.580716 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:37.597564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:37.653889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1421/2855] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:37.667772 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:37.670083 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:37.780910 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97ec50-f8e3-46aa-be58-4681f3c2dd11 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:37.784880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:37.785581 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:37.785858 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:37.786232 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:37.796627 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:37.806522 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18b29c-037b-4880-8613-887e50612bdb service cinder] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:37.820813 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1435/2856] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:40.661134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:40.663230 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:40.771384 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55158a-c55b-4113-abd9-13bcab015f10 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:40.776701 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:40.777350 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:40.777632 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:40.777909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:40.779713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:40.791600 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:40.793404 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:40.803863 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1422/2857] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:41.538624 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3d7e-bdb7-4c05-bb8b-bd37a51317d8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:41.539242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3d7e-bdb7-4c05-bb8b-bd37a51317d8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:41.539354 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3d7e-bdb7-4c05-bb8b-bd37a51317d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:41.561795 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-36ec3d7e-bdb7-4c05-bb8b-bd37a51317d8 None None] MFA Rules not processed for user `6bbdaa939b9341fdabe3e5c19e0a1d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:41.563128 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-36ec3d7e-bdb7-4c05-bb8b-bd37a51317d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:41.570216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1436/2858] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:46.667522 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:46.669020 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:46.744568 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c0c63-e3f2-49bc-b8f9-ddaa5bcef495 service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:46.749909 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:46.750883 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:46.751120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:46.751377 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] PATH_INFO: `/v3/users/a5cec2754a9a4564bacadf2359552437` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:46.752578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5cec2754a9a4564bacadf2359552437)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:46.754824 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:46.842993 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:46.944300 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5cec2754a9a4564bacadf2359552437'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:46.945052 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5cec2754a9a4564bacadf2359552437'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:46.963217 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5cec2754a9a4564bacadf2359552437'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:46.976842 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5cec2754a9a4564bacadf2359552437'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.071512 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5cec2754a9a4564bacadf2359552437'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.079543 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1423/2859] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:18:46 2022] DELETE /identity/v3/users/a5cec2754a9a4564bacadf2359552437 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:47.084127 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36006f8-c58d-41ae-9184-51701397450d None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:47.084651 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36006f8-c58d-41ae-9184-51701397450d None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:47.085009 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36006f8-c58d-41ae-9184-51701397450d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:47.118218 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-b36006f8-c58d-41ae-9184-51701397450d None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:47.120685 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b36006f8-c58d-41ae-9184-51701397450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:47.183701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:47.208406 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1437/2860] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:47.218536 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:47.220102 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:47.322097 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46040c4d-900a-47a8-8ce2-10b97d1d3639 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:47.327505 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:47.328354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:47.328710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:47.330372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:47.345381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:47.347723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:47.371216 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1424/2861] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:47.782511 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36006f8-c58d-41ae-9184-51701397450d None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:47.783966 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-b36006f8-c58d-41ae-9184-51701397450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:47.803154 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36006f8-c58d-41ae-9184-51701397450d None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:47.803425 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:47.804244 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:47.804528 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:47.804809 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] PATH_INFO: `/v3/projects/7f9836b298c948f38acb7d7626230115` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:47.806199 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9836b298c948f38acb7d7626230115)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:47.808233 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:47.904881 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9836b298c948f38acb7d7626230115', 'request_id': 'req-ec609e0d-96ff-48c7-b5fd-156cef44401a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.910286 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9836b298c948f38acb7d7626230115', 'request_id': 'req-ec609e0d-96ff-48c7-b5fd-156cef44401a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.977059 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9836b298c948f38acb7d7626230115', 'request_id': 'req-ec609e0d-96ff-48c7-b5fd-156cef44401a'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.989266 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] The token cache is being invalidate because project 7f9836b298c948f38acb7d7626230115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:18:47.989552 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.990181 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ec609e0d-96ff-48c7-b5fd-156cef44401a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:18:47.991723 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1438/2862] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:18:47 2022] DELETE /identity/v3/projects/7f9836b298c948f38acb7d7626230115 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:18:57.357281 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=45,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:57.986297 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:18:58.773982 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:58.775461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:58.787657 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3edd-1405-41d4-ad8c-e3a28265832b service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:58.844994 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:58.845607 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:58.845889 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:58.846167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:58.847953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:58.914575 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:58.918394 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:58.927901 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1425/2863] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:18:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:18:59.065448 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b6d7-dff0-40fc-8a89-af4148e782db None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:59.065921 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b6d7-dff0-40fc-8a89-af4148e782db None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:59.066042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b6d7-dff0-40fc-8a89-af4148e782db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:59.085968 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-08c7b6d7-dff0-40fc-8a89-af4148e782db None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:18:59.087228 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-08c7b6d7-dff0-40fc-8a89-af4148e782db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:59.144567 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1439/2864] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:18:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:18:59.158615 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:18:59.160134 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:18:59.230580 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e538081-a155-4053-898e-43a0bfa9da0b service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:18:59.235929 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:18:59.236544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:18:59.236849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:18:59.237094 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:18:59.245854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:18:59.247491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:18:59.255616 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1426/2865] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:18:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:19:00.074499 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543dbe-31c7-45c7-8e59-73474202ac1e None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:00.075005 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543dbe-31c7-45c7-8e59-73474202ac1e None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:00.075125 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543dbe-31c7-45c7-8e59-73474202ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:00.094992 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-58543dbe-31c7-45c7-8e59-73474202ac1e None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:00.096215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-58543dbe-31c7-45c7-8e59-73474202ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:00.103665 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1440/2866] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:00.116886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:00.128873 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571100b-8b02-43e4-8347-50758bd26ddc service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:00.134040 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:00.138593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:00.138593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:00.138593 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:00.144023 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:00.146085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:00.155333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1427/2867] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 13:19:00.765556 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeccdc-d927-445d-91dd-7ce3b7c5e97a None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:00.765839 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeccdc-d927-445d-91dd-7ce3b7c5e97a None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:00.766112 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeccdc-d927-445d-91dd-7ce3b7c5e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:00.793579 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-85aeccdc-d927-445d-91dd-7ce3b7c5e97a None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:00.795756 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-85aeccdc-d927-445d-91dd-7ce3b7c5e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:00.808489 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1441/2868] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Aug 3 13:19:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:00.828333 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:00.832345 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee3484-f557-478e-af29-2c4d18e41448 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:00.840538 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:00.841175 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:00.841455 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:00.841727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:00.850546 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:00.852156 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:00.861166 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1428/2869] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:19:01.606387 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:01.606935 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:01.607215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:01.628386 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:01.629690 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:01.638819 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1442/2870] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:19:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:01.653184 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:01.663832 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca489f-2d2f-43fb-a36e-d33d7e4feff9 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:01.670360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:01.671130 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:01.671504 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:01.671886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:01.681573 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:01.683744 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30010-f8d4-4fe9-b0f2-c20cad066fc7 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:01.698834 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:01.705369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1429/2871] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:19:04.581500 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:04.583662 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:04.663583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082376c-4bae-445e-859f-4fbe93a249ce None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:04.670281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:04.670281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.670281 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.670582 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] PATH_INFO: `/v3/users/6bbdaa939b9341fdabe3e5c19e0a1d69` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.671676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbdaa939b9341fdabe3e5c19e0a1d69)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:04.673617 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:04.847933 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbdaa939b9341fdabe3e5c19e0a1d69'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.848689 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbdaa939b9341fdabe3e5c19e0a1d69'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.849439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbdaa939b9341fdabe3e5c19e0a1d69'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.865599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbdaa939b9341fdabe3e5c19e0a1d69'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.946338 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbdaa939b9341fdabe3e5c19e0a1d69'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:04.962620 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1443/2872] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:19:04 2022] DELETE /identity/v3/users/6bbdaa939b9341fdabe3e5c19e0a1d69 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:04.967199 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60488-6357-4210-b923-069931324325 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:04.968061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60488-6357-4210-b923-069931324325 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:04.968442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60488-6357-4210-b923-069931324325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:04.988953 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cff60488-6357-4210-b923-069931324325 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:04.990289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cff60488-6357-4210-b923-069931324325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.077942 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1430/2873] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:05.086391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.089388 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.110741 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:05.170994 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1be9-92f1-4ed9-a094-2eb3b82f1c70 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:05.174754 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:05.175384 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.175666 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.175942 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.185473 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:05.186944 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e39f41-184a-4463-8fc3-0e0940f4fef8 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:05.196484 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1444/2874] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:05.427061 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60488-6357-4210-b923-069931324325 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.428497 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cff60488-6357-4210-b923-069931324325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.447965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60488-6357-4210-b923-069931324325 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:05.453872 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:05.454528 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.454927 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.455092 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] PATH_INFO: `/v3/projects/1c665ef1f6d841c78e0d1bc95de2fac3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.456395 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c665ef1f6d841c78e0d1bc95de2fac3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:05.458312 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:05.563465 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c665ef1f6d841c78e0d1bc95de2fac3', 'request_id': 'req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:05.569644 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c665ef1f6d841c78e0d1bc95de2fac3', 'request_id': 'req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:05.576246 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c665ef1f6d841c78e0d1bc95de2fac3', 'request_id': 'req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:05.659012 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] The token cache is being invalidate because project 1c665ef1f6d841c78e0d1bc95de2fac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:19:05.659349 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:05.659965 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-22b5d712-dfc9-4ed2-8689-2a8114a8e6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:05.661529 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1431/2875] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:19:05 2022] DELETE /identity/v3/projects/1c665ef1f6d841c78e0d1bc95de2fac3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:05.666618 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.667113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.669684 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.687133 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:05.688295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.747977 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1445/2876] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:05.755775 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.756085 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.756356 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.777491 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:05.778688 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:05.786433 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1432/2877] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:05.790675 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.800864 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422c72c-6f18-4e64-8ae3-ee9404a516c8 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:05.805491 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:05.806100 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.806376 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.806647 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.807391 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:19:05.808470 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:05.810169 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:05.821477 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1446/2878] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Aug 3 13:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:19:05.825677 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.834954 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db424b-b98c-40de-886f-8ebb644aa7a9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:05.839695 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:05.840297 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:05.840578 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:05.840854 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:05.841513 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:05.843467 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:05.941544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1433/2879] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Aug 3 13:19:05 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:19:05.945753 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:05.956033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ced2d0-d611-48bb-ace7-793834bda4c8 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.011793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.012501 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.012785 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.013061 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] PATH_INFO: `/v3/users` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.013721 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.015679 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.088678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1447/2880] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Aug 3 13:19:05 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:19:06.093279 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:06.105284 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602e032-6f91-4cc3-b330-1fce26b5c6f0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.110120 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.110897 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.111183 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.111461 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.112154 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.113755 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.124228 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1434/2881] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:19:06.128346 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:06.138505 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddee75-3c11-4df1-a468-adc873415360 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.143136 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.143737 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.144020 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.144295 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.144985 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.146890 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28562c-d790-41e1-8ea1-9bc5d12993a7 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.157747 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1448/2882] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 13:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:19:06.161732 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:06.172812 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3f97f-db50-42d5-b91a-4b9a7dc74b3a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.177544 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.178189 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.178466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.178768 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] PATH_INFO: `/v3/projects/abd64e26bef749e2ba3ca55c5e60b63b/users/5f9c4b5de9fd471aac1dbf7857154c2b/roles/512a2d0f4ecb4913981854e03206b2e9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.193614 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd64e26bef749e2ba3ca55c5e60b63b, user_id=5f9c4b5de9fd471aac1dbf7857154c2b, role_id=512a2d0f4ecb4913981854e03206b2e9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.196231 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.283466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1435/2883] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Aug 3 13:19:06 2022] PUT /identity/v3/projects/abd64e26bef749e2ba3ca55c5e60b63b/users/5f9c4b5de9fd471aac1dbf7857154c2b/roles/512a2d0f4ecb4913981854e03206b2e9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:06.294946 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.295238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.295517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.320024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:06.322932 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] MFA Rules not processed for user `5f9c4b5de9fd471aac1dbf7857154c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:06.324209 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:06.388215 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1449/2884] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:19:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:19:06.399451 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:06.401757 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:06.424626 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:06.459499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5ce8b-4639-4158-b7be-8dbbac29db3b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:06.464439 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31fc272e5f24eac95630f0fced91df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:06.465179 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:06.465457 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:06.465727 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:06.474289 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:06.479173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd039-a110-42ed-897e-daded3907337 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:06.485322 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1436/2885] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:16.417014 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=26 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:16.522438 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=17 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:18.085951 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:18.149823 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58b9e6-2d8b-4be3-8ac6-bd721db3b788 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:18.154357 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:18.161846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:18.161846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:18.161846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] PATH_INFO: `/v3/users/5f9c4b5de9fd471aac1dbf7857154c2b` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:18.161846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9c4b5de9fd471aac1dbf7857154c2b)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:18.161846 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:18.324455 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9c4b5de9fd471aac1dbf7857154c2b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:18.325069 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9c4b5de9fd471aac1dbf7857154c2b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:18.325676 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9c4b5de9fd471aac1dbf7857154c2b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:18.337963 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9c4b5de9fd471aac1dbf7857154c2b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:18.396884 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9c4b5de9fd471aac1dbf7857154c2b'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:18.409315 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1450/2886] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:19:18 2022] DELETE /identity/v3/users/5f9c4b5de9fd471aac1dbf7857154c2b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:18.413783 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:18.414421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:18.414421 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:18.433802 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] MFA Rules not processed for user `d5aedfbd59554662a405705e61102c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:19:18.435041 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:18.493817 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1437/2887] 10.222.0.67 () {58 vars in 958 bytes} [Wed Aug 3 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:19:18.504239 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:18.505629 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:18.562235 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551731-cb40-4fbc-9755-2efc1cb8b451 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:18.566135 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:18.566775 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:18.567095 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:18.567367 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:18.576748 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:18.578594 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276057bc-324b-4674-91c4-7701cc00d642 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:18.587978 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1451/2888] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:19:19.009710 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:19:19.011235 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:19:19.028372 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995f79a-e534-429a-b0e0-0cec063d7ef8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:19:19.035397 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:19:19.036072 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:19:19.036381 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:19:19.036617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] PATH_INFO: `/v3/projects/abd64e26bef749e2ba3ca55c5e60b63b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:19:19.037978 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd64e26bef749e2ba3ca55c5e60b63b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:19:19.039951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:19:19.137080 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd64e26bef749e2ba3ca55c5e60b63b', 'request_id': 'req-e5df0fb8-7167-4c40-97e2-f1092f3f8650'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:19.143480 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd64e26bef749e2ba3ca55c5e60b63b', 'request_id': 'req-e5df0fb8-7167-4c40-97e2-f1092f3f8650'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:19.149509 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd64e26bef749e2ba3ca55c5e60b63b', 'request_id': 'req-e5df0fb8-7167-4c40-97e2-f1092f3f8650'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:19.216086 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] The token cache is being invalidate because project abd64e26bef749e2ba3ca55c5e60b63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:19:19.216373 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:19.217006 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e5df0fb8-7167-4c40-97e2-f1092f3f8650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:19:19.219226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1438/2889] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:19:19 2022] DELETE /identity/v3/projects/abd64e26bef749e2ba3ca55c5e60b63b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:19:28.583778 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:19:29.212910 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:18.085080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.085710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.085710 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] PATH_INFO: `/` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.087236 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1452/2890] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:20:18.093057 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916b5f-8586-4f9b-a5a4-75b33bcabe70 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.093550 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916b5f-8586-4f9b-a5a4-75b33bcabe70 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.093764 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91916b5f-8586-4f9b-a5a4-75b33bcabe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.118811 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-91916b5f-8586-4f9b-a5a4-75b33bcabe70 None None] MFA Rules not processed for user `3c1c76b285a347fe8fea56f5eda4da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:20:18.119759 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-91916b5f-8586-4f9b-a5a4-75b33bcabe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:18.172539 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1439/2891] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:20:18.185269 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:18.187052 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:18.203410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32191f66-c4ac-4572-9a73-5b4b435dcf75 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:18.207355 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:18.207998 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.208275 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.208549 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.216865 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:18.218353 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91c5dd-cfcd-4c3b-8aeb-4499c4361d41 service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:18.226416 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1453/2892] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:18.309670 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.309951 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.310223 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.311700 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1440/2893] 10.222.0.67 () {54 vars in 921 bytes} [Wed Aug 3 13:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 13:20:18.316749 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa5ba-e679-4639-a139-6130fd1bd1a2 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.317036 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa5ba-e679-4639-a139-6130fd1bd1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.317316 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2aa5ba-e679-4639-a139-6130fd1bd1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.349042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-9e2aa5ba-e679-4639-a139-6130fd1bd1a2 None None] MFA Rules not processed for user `1035c2a2b6b8440a9d975751de4724da`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:20:18.350238 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9e2aa5ba-e679-4639-a139-6130fd1bd1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:18.426411 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1454/2894] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Aug 3 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:20:18.440335 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:18.442211 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:18.456609 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfb31-2ad4-4d4a-8fd4-a9e0e4e0f317 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:18.460354 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:18.465266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:18.465266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:18.465266 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:18.472464 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:18.473886 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:18.485444 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1441/2895] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:24.435372 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] REQUEST_METHOD: `POST` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:24.435880 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:24.435988 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:24.455793 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.auth.core [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] MFA Rules not processed for user `d176ff80e8f04492854430a646c90317`. Rule list: `[]` (Enabled: `True`). {{(pid=80454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:20:24.457287 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:24.512222 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1455/2896] 10.222.0.67 () {58 vars in 967 bytes} [Wed Aug 3 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:20:24.657066 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:24.658466 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:24.728167 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699562-605e-4e37-8d0b-aa9866e471ea service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:24.734044 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57923b067b6e441ea8d516d830cdf7de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:24.734691 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:24.735070 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:24.735347 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:24.743495 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:24.745724 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:24.754022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1442/2897] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Aug 3 13:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:20:29.816008 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:29.825565 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433443ca-9170-4b4b-b43f-5194f2dd4751 None None] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:29.829171 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:29.829829 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:29.830121 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:29.830385 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:29.832242 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:29.846216 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:29.847704 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:29.860857 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1456/2898] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:20:32.840675 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:32.842163 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:32.906849 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae1d9-119d-4651-a6fd-1cb3cb01d091 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:32.911478 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:32.912103 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:32.912379 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:32.912698 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] PATH_INFO: `/v3/users/1c8cf21524db41daa185f432aa442ceb` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:32.913781 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8cf21524db41daa185f432aa442ceb)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:32.915723 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:33.026831 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:33.143926 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8cf21524db41daa185f432aa442ceb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.144975 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8cf21524db41daa185f432aa442ceb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.153460 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8cf21524db41daa185f432aa442ceb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.169713 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8cf21524db41daa185f432aa442ceb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.232662 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8cf21524db41daa185f432aa442ceb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.238825 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1443/2899] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:20:32 2022] DELETE /identity/v3/users/1c8cf21524db41daa185f432aa442ceb => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:20:33.488603 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:33.502124 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adbcdf-3306-42e9-9df8-734efe59548a service neutron] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:33.551701 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:33.561752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:33.562394 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:33.562674 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:33.563046 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] PATH_INFO: `/v3/projects/e7e1213cd973452f8704bcf696e98a81` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:33.564192 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e1213cd973452f8704bcf696e98a81)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:33.566097 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:33.641138 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e1213cd973452f8704bcf696e98a81', 'request_id': 'req-29391a6f-681f-4c52-84a0-68b3d66b7e46'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.646807 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e1213cd973452f8704bcf696e98a81', 'request_id': 'req-29391a6f-681f-4c52-84a0-68b3d66b7e46'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.707261 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e1213cd973452f8704bcf696e98a81', 'request_id': 'req-29391a6f-681f-4c52-84a0-68b3d66b7e46'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.719303 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] The token cache is being invalidate because project e7e1213cd973452f8704bcf696e98a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:20:33.722070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.722070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.722070 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1457/2900] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:20:33 2022] DELETE /identity/v3/projects/e7e1213cd973452f8704bcf696e98a81 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:20:33.725882 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:33.727343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:33.740789 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278e615-3fd0-466c-ad93-e0a12dac915d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:33.797458 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:33.798093 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:33.798375 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:33.798653 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] PATH_INFO: `/v3/users/327104a2c01947e0b115bd3f58e10003` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:33.799848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327104a2c01947e0b115bd3f58e10003)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:33.801778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:33.958816 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327104a2c01947e0b115bd3f58e10003'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.959469 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327104a2c01947e0b115bd3f58e10003'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.966514 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327104a2c01947e0b115bd3f58e10003'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:33.978564 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327104a2c01947e0b115bd3f58e10003'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.052905 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327104a2c01947e0b115bd3f58e10003'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.059758 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1444/2901] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:20:33 2022] DELETE /identity/v3/users/327104a2c01947e0b115bd3f58e10003 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:20:34.312458 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:20:34.313936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:20:34.328745 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29391a6f-681f-4c52-84a0-68b3d66b7e46 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:20:34.389256 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:20:34.389891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:20:34.390166 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:20:34.390439 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] PATH_INFO: `/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:20:34.391606 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=706e2ee2c72442cb86d21a3f3b1fe263)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:20:34.393769 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:20:34.533580 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706e2ee2c72442cb86d21a3f3b1fe263', 'request_id': 'req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.539428 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706e2ee2c72442cb86d21a3f3b1fe263', 'request_id': 'req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.612922 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706e2ee2c72442cb86d21a3f3b1fe263', 'request_id': 'req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.624641 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] The token cache is being invalidate because project 706e2ee2c72442cb86d21a3f3b1fe263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:20:34.624927 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.625548 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:20:34.627104 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1458/2902] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:20:34 2022] DELETE /identity/v3/projects/706e2ee2c72442cb86d21a3f3b1fe263 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:20:44.055462 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:20:44.621613 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=79,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:33.986106 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:33.987647 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:34.045095 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756824a-1dfa-4eb9-92d9-120e71f4e814 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:34.095840 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:34.096453 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:34.096734 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:34.097007 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:34.098754 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:34.107890 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:34.109343 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:34.117643 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1445/2903] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:21:43.796883 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:43.804298 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:43.883980 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ecfbc-86f4-4b75-8679-b3579bbbaedf admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:43.889750 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1035c2a2b6b8440a9d975751de4724da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:43.890440 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:43.890752 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:43.891032 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:43.893191 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:43.905936 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:43.907583 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:43.919300 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1459/2904] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:21:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:21:44.114131 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=46 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:45.447008 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:45.448447 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:45.459576 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787784-a9f4-4b98-8806-ec127b78c60f service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:45.463369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c1c76b285a347fe8fea56f5eda4da12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:45.463968 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:45.464248 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:45.464525 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:45.466193 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:45.480247 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:45.481663 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:45.492778 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1446/2905] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:21:52.771678 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:52.773217 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:52.845326 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc5f9a-5e67-40b5-98d7-5525a4f44074 service nova] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:52.850412 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:52.851060 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] REQUEST_METHOD: `GET` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:52.851340 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:52.851612 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:52.853351 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:52.865727 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:52.867410 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:52.878761 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1460/2906] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:21:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:21:55.487893 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:56.229751 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:56.231263 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:56.299098 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b7644-efa2-45b5-ad42-23dcc539582e service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:56.303617 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:56.304244 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:56.304521 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:56.304794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] PATH_INFO: `/v3/users/f17178cb25424167a1e55d5a3692461b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:56.305939 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17178cb25424167a1e55d5a3692461b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:56.307880 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:56.518318 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17178cb25424167a1e55d5a3692461b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:56.518995 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17178cb25424167a1e55d5a3692461b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:56.526393 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17178cb25424167a1e55d5a3692461b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:56.538419 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17178cb25424167a1e55d5a3692461b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:56.628947 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17178cb25424167a1e55d5a3692461b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:56.635234 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1447/2907] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:21:56 2022] DELETE /identity/v3/users/f17178cb25424167a1e55d5a3692461b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:21:56.894042 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:56.905098 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d53f-bfed-4f17-adfa-2d1765ee9e19 service placement] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:56.962672 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:56.964187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:56.964187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:56.964187 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] PATH_INFO: `/v3/projects/73d7f2a77b514846ae3a4f6c512701d2` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:56.965081 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d7f2a77b514846ae3a4f6c512701d2)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:56.967024 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:56.983599 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=100 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:57.130891 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d7f2a77b514846ae3a4f6c512701d2', 'request_id': 'req-ecbcd866-272c-4864-bf53-9ed0f7502388'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.136307 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d7f2a77b514846ae3a4f6c512701d2', 'request_id': 'req-ecbcd866-272c-4864-bf53-9ed0f7502388'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.226485 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d7f2a77b514846ae3a4f6c512701d2', 'request_id': 'req-ecbcd866-272c-4864-bf53-9ed0f7502388'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.238080 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] The token cache is being invalidate because project 73d7f2a77b514846ae3a4f6c512701d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:21:57.238368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.239015 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.240517 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1461/2908] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:21:56 2022] DELETE /identity/v3/projects/73d7f2a77b514846ae3a4f6c512701d2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:21:57.244567 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:57.246009 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:57.259499 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535fae-090a-438f-ae6e-0daa67c9153b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:57.317254 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:57.317891 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:57.318173 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:57.318442 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] PATH_INFO: `/v3/users/0af0800bf4854d3ba93bd6ff9f70f67b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:57.319636 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af0800bf4854d3ba93bd6ff9f70f67b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:57.321542 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:57.346078 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:21:57.503445 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af0800bf4854d3ba93bd6ff9f70f67b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.504100 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af0800bf4854d3ba93bd6ff9f70f67b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.510989 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af0800bf4854d3ba93bd6ff9f70f67b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.523369 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af0800bf4854d3ba93bd6ff9f70f67b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.595541 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af0800bf4854d3ba93bd6ff9f70f67b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:57.601756 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1448/2909] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 13:21:57 2022] DELETE /identity/v3/users/0af0800bf4854d3ba93bd6ff9f70f67b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:21:57.849033 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Authenticating user token {{(pid=80454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:21:57.850504 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.fernet_utils [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:21:57.864538 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcd866-272c-4864-bf53-9ed0f7502388 admin admin] Validating token access rules against request {{(pid=80454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:21:57.924113 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5aedfbd59554662a405705e61102c08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd5462246264f9f811047550f1e206f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:21:57.924789 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:21:57.925017 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:21:57.925285 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] PATH_INFO: `/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53` {{(pid=80454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:21:57.926429 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbeab67fbfd84644b7d7f8b86477dc53)` {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:21:57.928350 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] RBAC: Authorization granted {{(pid=80454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:21:58.055368 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbeab67fbfd84644b7d7f8b86477dc53', 'request_id': 'req-eb454911-5374-45bc-81a9-1e4509812430'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:58.060751 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbeab67fbfd84644b7d7f8b86477dc53', 'request_id': 'req-eb454911-5374-45bc-81a9-1e4509812430'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:58.140296 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbeab67fbfd84644b7d7f8b86477dc53', 'request_id': 'req-eb454911-5374-45bc-81a9-1e4509812430'} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:58.152952 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] The token cache is being invalidate because project dbeab67fbfd84644b7d7f8b86477dc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:21:58.153255 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:58.153887 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG keystone.notifications [None req-eb454911-5374-45bc-81a9-1e4509812430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:21:58.155434 dv-cinder-851996-1-smb devstack@keystone.service[80454]: [pid: 80454|app: 0|req: 1462/2910] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 13:21:57 2022] DELETE /identity/v3/projects/dbeab67fbfd84644b7d7f8b86477dc53 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:22:07.598226 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:22:08.150064 dv-cinder-851996-1-smb devstack@keystone.service[80454]: DEBUG dbcounter [-] [80454] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:24:39.274355 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:24:39.276296 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:24:39.344360 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73922-6687-48da-8845-be67de61bf95 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:24:39.403848 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f523bf78506741138174ea01898f58df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c6b843647f6493fba5ea204a7010d71', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:24:39.404489 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:24:39.404766 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:24:39.405035 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:24:39.406857 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:24:39.418773 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:24:39.427687 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246cdaa-22a6-45e7-9e4f-d03073cb5860 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:24:39.430022 dv-cinder-851996-1-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1449/2911] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Aug 3 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:24:49.425794 dv-cinder-851996-1-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=58 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}